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Abstract 

Nonequilibrium systems driven by additive or multiplicative dichotomous Markov noise appear 
in a wide variety of physical and mathematical models. We review here some prototypical exam- 
ples, with an emphasis on analytically-solvable situations. In particular, it has escaped attention 
till recently that the standard results for the long-time properties of such systems cannot be ap- 
plied when unstable fixed points are crossed in the asymptotic regime. We show how calculations 
have to be modified to deal with these cases and present a few relevant applications - the hyper- 
sensitive transport, the rocking ratchet, and the stochastic Stokes' drift. These results reinforce 
the impression that dichotomous noise can be put on a par with Gaussian white noise as far as 
obtaining analytical results is concerned. They convincingly illustrate the interplay between noise 
and nonlinearity in generating nontrivial behaviors of nonequilibrium systems and point to various 
practical applications. 



I. INTRODUCTION 



The statistical theory of out-of-equihbrium systems is one of the most challenging, rapidly 
evolving, and an interdisciplinary domain of modern research. Its fundamental importance 
is rooted in the fact that the majority of the situations encountered in nature (in its broadest 
sense, including physical, chemical, and biological systems) are nonequilibrium ones. Such 
systems exhibit very complex and often counter-intuitive behaviors, resulting from a generic 
interplay between a large number of degrees of freedom, nonlinearities, "noise" or pertur- 
bations of various origins, driving forces and dissipation (corresponding to various levels of 
coarse-grained description). 

Usually, noise and stochastic equations appear in the modeling when one concentrates the 
study on a few relevant variables (hereafter called "system under study" ) and approximates 
the effects of the eliminated degrees of freedom through a "random force" or "noise" with 
prescribed statistical properties. In particular, these eliminated degrees of freedom have a 
characteristic time scale, that is translated into the specific correlation time of the noise that 
intends to mimic them. 

In many situations of interest, the characteristic response time of the system under study 
is much larger than this specific time scale of the eliminated variables. Following the sem- 
inal works of Einstein, Langevin and Smoluchowsky, the noise is then safely modeled as a 
Gaussian white noise (GWN) that is (5-correlated in time. In this case the model system is 
generically referred to as a "Brownian particle" . The Brownian motion under the action of 
the GWN is a Wiener process, and a detailed mathematical analysis can be carried on the 
basis of Langevin or Fokker-Planck equations. 

The Wiener process and the GWN are, of course, stochastic processes of fundamental 
importance. However, they do not exhaust all the situations one may be called to model. 
Indeed, there are cases when the eliminated degrees of freedom are slow on the time scale of 
the studied system. Then one has to mimic the result of the coarse-graining over such a set of 
slow variables through a colored noise, i.e., a noise that has a non- negligible correlation time 
(and thus a non- fiat power spectrum). Such noises have been studied in great detail in zero- 
dimensional systems, and their specific properties are known to have a profound influence 
on the behavior of these systems. Generically, they lead the system out of equilibrium (they 
break the detailed balance in the configuration space of the system). The effect of the color 
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of the noise on noise-induced transitions and phase transitions continues to be documented, 
and has been found to be quite important, e.g., it can aher the type of transition and lead 
to re-entrance phenomena. Other noise-induced effects have also been found to be sensitive 
to the correlation time of the noise, like the stochastic resonance, the synchronization of 
several noisy dynamical units, and the directed transport in ratchets. 

The two most commonly discussed examples of colored noise are the Ornstein-Uhlenbeck 
process and the dichotomous Markov noise (DMN). Although the Ornstein-Uhlenbeck pro- 
cess is easily invoked in view of Doob's theorem 203|, the purpose of this review is to show 
that DMN has particular virtues and interest. 

But before proceeding with this argumentation, let us define the DMN and describe its 
main stochastic properties. 

A. Definition of DMN 

The DMN ^{t) is a very simple two-valued -iiA± stochastic process, with constant transi- 
tion rates k± between the two states . Figure ^ illustrates a realization of DMN. The 
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FIG. 1: A realization of an asymmetric DMN ^(t) that jumps between two values iA± with 
constant transition rates k-i-. The waiting times t± in the two states are exponentially-distributed 
stochastic variables, thus ensuring the Markovian character of the DMN, see the main text. 
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constancy of the transition rates corresponds to exponentially distributed waiting times t± 
in the two states, 

Probability (r-t) = k±exp{—k±T±) (1) 

(i.e., the transitions are driven by Poisson renewal processes) and DMN is Markovian. It 
is therefore completely characterized by the initial state and the matrix of the transition 
probabilities. 



[Probability(e(t) = tA,\m = jA,)] 
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where 



1 



(2) 



(3) 



k+ + k^ 

is the characteristic relaxation time to the stationary state of the DMN. In the foregoing we 
shall be exclusively concerned with stationary DMN, for which the stationary probabilities 
of the two states are 



Probability(^ = = k^Tc , Probability(^ = —A^) = k^ Tc 



with the corresponding mean value 



m) = {k.A^-k+A^)rc 



(4) 



(5) 



Moreover, we shall generally consider zero-mean DMN, {^{t)) = 0, in order to avoid any 
systematic bias introduced by the noise in the dynamics of the driven system. The stationary 
temporal autocorrelation function of DMN is exponentially-decaying 



(ewe(0) = -exp 



\t-t'\ 



corresponding to a finite correlation time and an "amplitude" 



D = k+k_T^{A+ + A. 



(6) 



(7) 



The power spectrum is thus a Lorenzian related to the characteristic time scale Tc 



so the DMN is indeed colored. 

A particular case of DMN, that will be widely used in the foregoing, is that of the 
symmetric DMN, for which = A„ = A and kj^ = = k, so that the correlation time is 
Tc = {2k)-^, and the "amplitude" D = A^/(2k), with, moreover, (^(t)) = 0. 

Let us underline yet another important property of the stationary, zero-mean DMN, 
namely that in appropriate limits it reduces either to a white shot noise (WSN), or to a 
Gaussian white noise (GWN), see Ref. jsj for a detailed discussion. Figure El represents 
schematically these relationships. 
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FIG. 2: Schematic representation of the relationships between DMN and other important station- 
ary, zero-mean stochastic processes. DMN reduces to white shot noise or to Gaussian white noise 
in the appropriate limits (see the main text); however, DMN and the Ornstein-Uhlenbeck process 
cannot be mapped one onto the other. 

Consider the stationary asymmetric DMN of zero mean, characterized by three indepen- 
dent parameters (e.g., k± and with = A^/k^ = X. Then, by taking the limit 

A_, k_ ^ oo , while keeping A_/k_ = X = finite , (9) 
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one recovers the WSN driven by a Poisson process (also called the Campbell's process); this 
one is characterized by two parameters (A and, e.g., k^). Considering further on the limit 
A+, k+ oo with A ^ but = \'^k+ = A\/k+ = finite, WSN reduces to a GWN; this 
latter is characterized by a single parameter, the noise "amplitude" D. 

Note also that the symmetric DMN can reduce directly (i.e., without passing through 
the stage of a WSN) to the GWN by taking simultaneously the limits A, k ^ oo, such that 
D = Tc = A^ /{2k) = finite represents the amplitude of the GWN. 

There is no mapping possible between DMN and the Ornstein-Uhlenbeck process: indeed, 
one cannot eliminate the non- Gaussian character of the DMN while keeping a finite correla- 
tion time. The two noises have distinct statistical properties, a point that is also generally 
refiected in the response properties of the dynamical systems driven by these noises. How- 
ever, as indicated by the central limit theorem, the superposition of M suitably-scaled, inde- 
pendent DMNs C,i{t) ,i = 1, M , converges in the limit M ^ oo to an Ornstein-Uhlenbeck 
process. This property may be used to tackle systems driven by an Ornstein-Uhlenbeck noise 
(that are notoriously difficult to study) by constructing approximate solutions corresponding 
to the superposition of several DMNs. 

B. Motivation, relevance, and the importance of using DMN 

This review is intended to present DMN as a tool for modeling stochastic processes. We 
shall thus try to clarify its applicability, fiexibility, and limits, as well as to describe a few 
prototypical applications. Several essential points, briefiy resumed below, will be resulting 
from this review. 

• As it will become clear, systems driven by DMN are encountered in a wide variety of 
physical and mathematical models. Besides the "fashion-effect" (peaked around the 
1970s), there are deeper reasons to this and we shall address them. 

• A basic point is that DMN mimics the effects of finite correlation time (colour) of 
the noise in a very simple way. It constitutes thus a good alternative to the widely- 
spread Ornstein-Uhlenbeck process, which is often quite untractable analytically. So, 
the DMN reflects the effect of the eliminated slow degrees of freedom on the dynamics 
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of the relevant variables under study. Refer for example to Refs. for detailed 

discussions on this essential point of the modeling of stochastic systems. 

Moreover, the interplay between the intrinsic time scale of the DMN and other time 
scales present in the problem (e.g., characteristic relaxation time of the system under 
study, external periodic perturbations, etc.) may lead to nontrivial effects (e.g., 
mult ist ability and hysteretic behavior, stochastic resonance, synchronization effects, 
etc.). These effects are absent when a white noise is acting (even multiplicatively !) 
on the system. 



One has to realize that DMN may be directly a very good representation of a simple and 
frequently- encountered physical situation, namely that of the thermally activated transi- 
tions between two configurations/states of a system (as far as the "intra-configuration" 
motion is unimportant, filtered-out or coarse-grained). 

A very clear illustration is offered by the small electronic devices (e.g., MOSFET, 
MIM, JFET, point-contact resistances, etc.), as described in the review article 

n 

Ref. j8|]. The active volume of such devices is so small that they contain only a 
reduced number of charge carriers; then the alternate capture and emission of carriers 
at individual defect sites generates measurable discrete jumps in the device resistance. 
These jumps are naturally modeled as a DMN process. Their study provides a 
powerful mean of investigating the nature of defects at the interfaces, the kinetics of 
carriers' capture and emission (see, e.g., Ref. ^ for a recent experimental example), 
and has demonstrated the defect origin of low-frequency 1// noise in these devices, etc. 



• Generically, DMN drives the system out- of- equilibrium (i.e., it breaks the detailed 
balance in the configuration space of the system). Therefore it may lead to novel 
behaviors that are not accessible in equilibrium systems (like, for example, directed 
transport out of microscopic fluctuations). In particular, memory effects may become 
important - the driven system is typically non-Markovian. 



• On one hand, DMN is "sufficiently simple" so that it often allows for full analytical 
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description, and it represents therefore a good research, as well as didactical tool. The 
emphasis of our presentation will thus be, to the largest possible extent, on ana lytically- 



solvable models and on exact results, as stated in the title of this review 



204|. 



Moreover, the "simplicity" of DMN allows to dissect the essential mechanisms at work 
behind various nonequilibrium, often seemingly complex phenomena. One can thus 
reveal the "minimal scenario" and ingredients for the appearance of these processes. 



On the other hand, DMN is "sufficiently rich" so that it leads to highly nontrivial and 
varied nonequilibrium behaviors in nonlinear systems. This illustrates once more the 
fundamental fact that stochasticity may affect the dynamics more strongly than just 
a simple perturbation around the deterministic evolution: it may induce qualitatively 
different behaviors. 



As it was mentioned above, DMN reduces, in appropriate limits, to WSN and to GWN, 
and thus offers an alternative way of solving problems connected with these noises (in 
particular, master equation for DMN is often simpler to solve than the Fokker-Planck 
equation for GWN). 

Let us also note that the relationship of DMN with the G WN p layed a role in the 
'amous (and unfounded !) ltd versus Stratonovich dilemma jsO^, see Refs. and 
sj for pertinent comments on this point. 

From the point of view of numerical simulations, DMN has the advantage of being 
easy to implement as an external noise with finite support. 



Last, but surely not least, systems driven by DMN point to interesting practical ap- 
plications. 
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C. The structure of the review 

Despite an impressive literature on the systems driven by DMN, the main hnes and 
subjects of interest are easy to infer. The type of systems that are generically studied are 
zero- dimensional dichotomous flows, corresponding to a single stochastic variable driven by 
a DMN that may be additive or multiplicative, as described in Sec. II. We shall be first 
addressing in Sec. Ill the problem of the transient (time-dependent) characteristics of such 
flows, that might be important for some practical applications and/or finite observation 
times. We shall classify the "solvable" cases and discuss in detail the seminal example of the 
dichotomous diffusion on a line. We shall turn afterwards to the "more productive" study of 
the asymptotic, long-time behavior of the dichotomous flows. As it will become clear, both 
the physics and the mathematical approach are very different if the asymptotic dynamics 
exhibits or not unstable critical points - this represents a main point of this review. The 
"standard old theories" were limited to the absence of unstable critical points, as described 
in Sec. IV. Most of the results referred to the celebrated noise-induced transitions and phase 
transitions that we shall briefly present. In Sec. V we turn to the situations when the 
asymptotic dynamics presents unstable critical points. We show how calculations have to be 
modified in order to deal with such situations and illustrate the method on three prototypical 
examples, namely the hypersensitive response, the rocking ratchet, and the stochastic Stokes' 
drift. Section VI will be devoted to a brief presentation of escape statistics (mean first- 
passage time problems, resonant activation over a fluctuating barrier, etc.). In Sec. VII 
we shall discuss the stochastic resonance phenomenon and its DMN- induced enhancement. 
Section VIII is devoted to some comments on spatial patterns induced by DMN forcing, 
while Sec. IX describes briefly random maps with DMN. A few conclusions and perspectives 
are relegated to Sec. X. 

A last warning refers to the fact that this review is non-exhaustive (and we do apologize 
for the omissions), pedagogical to a large extent, and rather non-technical. We emphasized 
subjects that count amongst the most recent in this domain and in which we were directly 
involved. But, of course, all important earlier results are also described in detail, for the 
sake of a correct perspective on the field. 
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II. SYSTEMS DRIVEN BY DMN: DEFINITION OF DICHOTOMOUS FLOWS 



A zero-dimensional dichotomous flow corresponds to the temporal evolution of some 
characteristic scalar variable x = x{t) of the system under study, whose velocity switches 
at random between two dynamics: the "+" dynamics, x{t) = and the "-" dynamics, 

x(t) = f-{x) (the dot designates the time-derivative). This process can be described by the 
following stochastic differential equation: 



where ^{t) is a realization of the DMN taking the values ±A± with transition rates k± 
between these values, and f±{x) = f{x) ±g{x)A±. If g{x) is a constant, the DMN acts addi- 
tively; otherwise, for g{x) ^ constant, the noise is multiplicative. We shall consider through- 
out the paper only constant transition rates k±, although some recent stochastic nonequilib- 
rium models of protein motors use x-dependent transition rates k±{x), see Ref. jll|. Most 
of our results can be easily generalized to cover these situations too. Moreover, if not stated 
explicitely otherwise, we shall be working with a symmetric DMN, A± = A and k± = k. 

For the simplicity of the presentation, we shall often refer to x{t) as the "position of an 
overdamped particle"; but one should keep in mind that its actual nature depends on the 
system under study (i.e., that x{t) can be a spatial coordinate, a current, a concentration, a 
reaction coordinate, etc.). It is a stochastic process, and for most of the practical purposes 
its properties can be essentially described through the properties and evolution equation of 
the probability distribution function P(x, t) j206[. Indeed, one is in general interested by the 
the mean over the realizations of the DMN of an arbitrary function J^{x) of the stochastic 
variable x{t), a type of quantity that we shall denote throughout the text by (...): 



In the nonstationary regime of the dichotomous flow this is an explicit function of time, as 
discussed below. 

III. THE TIME-DEPENDENT PROBLEM 

One is, of course, tempted to address first the question of the non-stationary, transient 
stochastic behavior of the variable x{t), i.e., that of the temporal evolution of its proba- 



x{t) = f{x) +g{x)m, 



(10) 




(11) 
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bility density from a given initial state (a given initial probability distribution function) 
to the (presumably existent) asymptotic stationary state with the corresponding stationary 
probability distribution function. 

A. The master equation and the time-dependent "solvable" cases 

The master equation for the probability density of the compound (or vectorial) stochastic 
process [x{t), ^(t)], namely P±{x,t) = P{x,t]^ = ±1), can be easily written down. It 
corresponds to a Liouville flow in the phase space (describing the deterministic evolution 
between two jumps of the DMN) plus a gain-and-loss term (reflecting the switch of the DMN 
between its two values): 

dtP+{x,t) = -d,[f+{x) P+] - k{P+ - P_) , (12) 
dtP-{x,t) = -d4f4x) P.] + k{P+ - P„) (13) 

(see, e.g., Ref. for a detailed derivation). One is interested, however, in the 

evolution equation for the marginal probability density of the stochastic variable x{t), 
P(x, t) = P^{x,t) + P-{x,t), for which one obtains (using the above equations): 

dtP{x,t) = -d4f{x)P{x,t)] 

+A'd,g{x) [ dhexp[{-dJ{x)-2k){t-h)]dMx)P{x,h)]- (14) 
Jo 

This is an intricate integro- differential equation in time, with a kernel that involves the expo- 
nential of the differential operator d^- Thus, although the DMN is such a simple stochastic 
process, the statistics of the driven process x{t) may be remarkably complicated and, in 
general, x{t) is not a Markovian process. While the stationary solution Pst{x) to which the 
probability density P{x, t) tends in the asymptotic limit t oo can be computed under 
rather general conditions (see Sees. IV and V below), one can also address the legitimate 
question of the solvability of this time-dependent master equation (fT^ . 

A particularly relevant problem is whether one could construct/recover some Markovian 
process out of x{t). As shown recently in Refs. Q and Q, this is achieved in the so-called 
solvable cases, when P{x, t) obeys a closed partial differential equation of finite-order in 
time. If the order of this equation is n ^ 1, then one can construct a finite-dimensional 
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vectorial Markovian process out of x{t) and its temporal derivatives; more precisely, the 
vectorial process [x{t), x{t), x^"'~^\t)'j is Markovian. 

It is in this very point that lies the importance of knowing whether a dichotomous flow 
is solvable: if one can reconstruct a Markovian property at some level of differentiation of 
x{t), then the knowledge of a finite-number of initial conditions for the probability density 
and its time-derivatives are enough in order to determine entirely the subsequent evolution 
oiP{x,t). 

As discussed in detail in Refs. Q and Q, 

the condition of solvability is related to the 

behavior of the differential operators 

A=-d^4f{x)...], B = -dMx)...] (15) 
and the hierarchy of their comutators, 

Cn = [A,Cn^i] (n^l), with Co = B. (16) 



If this hierarchy closes, then P{x, t) satisfies a finite-order differential equation in time 
In more detail, if 



71-1 



Cn = J2f^f'^k, (17) 



k=0 



with some constants, then P{x,t) satisfies a partial differential equation of order (n + 1) 
in time. If the linear combination involves A as well, i.e., if 



n-l 



Cn = aA + J2l3kCk, (18) 

fc=0 

then the order of the equation is (n + 2). 

Despite the seeming simplicity of these criteria, one should realize that they are quite 
restrictive and thus the classes of solvable cases are rather reduced. 

In particular, the following cases are not solvable: 

(a) The cases with an additive DMN {g{x) = constant) and a nonlinear drift term {f{x) = 
nonlinear in x). 

(b) When either f{x) or g{x) is a polynomial of order ^ 2, P{x,t) does not satisfy in 
general a finite-order equation (although it may do so in special cases of specific relationships 
between the coefficients of the polynomials). 

A few examples of solvable cases: 
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(a) When /(x) = constant ■ g{x), i.e., Ci = 0, the process x{t) can be mapped, through a 
nonhnear transformation, onto a pure dichotomous diffusion for which the time-dependent 
solution is well-known (see the subsection below). 

(al) A subcase of interest is that of f{x) = Ag{x), so that f-{x) = 0. This corresponds 
to the so-called delayed evolution, in which the deterministic dynamics governed by the flow 
f+{x) = 2/(x) is interrupted at random instants and x remains frozen at its current value, 
till the noise switches back and the dynamics is continued. 

A closely-related type of flow, called interrupted evolution, is characterized by the fact 
that in the quiescent "-" state (/_ = 0) the stochastic variable is reset to a random value 
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drawn from a fixed distribution. See Ref. 
types of flows. 

(a2) When f{x) = 0, i.e., f+{x) = —f^{x), the problem reduces again to the dichotomous 
diffusion. This case is of interest, e.g., in problems invol ving the exchange of stability between 
two critical points of the alternate dynamics, see Ref. |l7l |. 

(b) Another case presented in the literature, see Ref. is that of Ci = —/SqB, i.e., 
f'{x)g{x) — g'{x)f{x) = Pog{x), when P(x,t) obeys a second-order differential equation. 
The early-day Hongler's model, see Ref. [l9|, with f{x) = — tanh(x) and g{x) = sech(x) fall 
in this class. 

An important warning, however: one should be aware of the fact that "solvable" in 
the sense indicated here above does not imply, in general, that one can express P{x,t) 
in a simple, closed algebraic form of some "standard" functions. Indeed, as explained in 
Refs. |l4| and Q, this is merely an exceptional situation, and probably the only case that 
was completely explored till now is that of the dichotomous diffusion (and processes that 
reduce to it through some change of variables). 

B. Dichotomous diffusion on a line 

It describes the stochastic position x{t) of a particle whose velocity is a DMN, i.e., it is 
represented by the following stochastic differential equation: 

xit) = m ■ (19) 
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The corresponding master equation for the probabihty densities P±{x,t) is 



dtP^ 



-Ad,P+ + k{P^ - P+) , dtP^ = Ad,P. + k{P+ - 



(20) 



(for the case of a symmetric DMN ±A with transition rate k). 

This simple process x(t) is an example of so-called pers isten t diffusion on a line as detailed 



in Refs. m 
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Indeed, it can be obtained |208l | as the continuum limit of a 



"persistent" random walk on a ID lattice, i.e., a random walk for which the transition 
probabilities left or right at a given stage depend on the direction of the preceding jump. 
This means that the jump probabilities have a "memory" of the previous state of the system, 
and therefore x{t) is no longer Markovian. However, according to the general discussion 
in Sec. III. A, the vectorial process [x(t), x{t)] is Markovian. The probability distribution 
P{x, t) obeys a second -orde r (in time) hyperbolic partial differential equation known as the 
telegrapher's equation \20^ : 



(dtt + 2kdt-A''d,,)P{x,t)=0. 



(21) 



Note that each of P±{x,t) also obeys this equation. Telegrapher's equation can be solved 
for various initial conditions of P{x,t) and its time- derivative P{x,t) 2^. The short-time 
behavior (for t <^Tc = l/2k) is governed by the wave-like part of the equation, i.e., the mean 
square displacement behaves ballistically: (x'^it)) ^ A'^t'^; while the long-time behavior (for 
t ^ Tc = 1/2A;) is of course diffusive, {x'^{t)) ^ {A^ /k)t = 2Dt, in agreement with the 
central-limit theorem. 

One can easily illustrate this behavior on the example of the "symmetric" initial condi- 
tions P{x, t = 0) = 6{x) and P{x, t = 0) = 0, when the solution of the telegrapher's equation 
can be expressed in terms of modified Bessel functions of zeroth and first order as: 



P{x,t) 



-[6{x - At) + 5{x + At)] 



2A 



+ 



^t^-x^A^ 



h {k^W^HF/A^ 



Jo (k^Jt^ - x^/A^ 

[e{x + At) - e{x - At)] 



(22) 



The terms in 5 (of amplitude that is decreasing exponentially in time) describe the ballistic 
motion corresponding to the persistence of DMN in the "+" or "-" state during time t. 
The remaining terms represent the sum of contributions resulting from trajectories that 
imply one, two, etc ... transitions between the "+" and "-" states of the DMN during time 
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t, and tend to a Gaussian (reflecting an usual Brownian motion) in the asymptotic limit. 
Henceforth, 

= ^ [2^^ - 1 + exp(-2H)] , (23) 
with the mentioned ballistic, respectively diffusive behavior for short and long times. 



1. Applications 

As reviewed in Ref. |2^, several physical situations can be modeled through a dichotomous 
diffusion and the telegrapher's equation, and we present them briefly below. For most 
of them the transient regime and its stochastic properties are important, in view of the 
finite-observation time, or the limited dimensions of the experimental device; from here the 
relevance of knowing the time-dependent statistics, and not only the asymptotic regime. 

(a) Broadening of peaks in a chromatographic column. 
A chromatographic column is a very simple device for separating particles of different char- 
acteristics; it consists of a cylindrical tube, where particles are drifted by a fluid, with mean 
velocities depending on their mobilities. So, at the end of the tube, one is expecting to 
receive neat "delta-peaks" of identical particles. It was noted experimentally, however, that 
there is a broadening of these peaks, i.e., the identical particles do not arrive exactly at 
the same moment at the end of the column (despite all the precautions related to ensuring 
identical initial conditions at the beginning of the tube, etc.). In the model proposed in 
Refs. j3| and [^^l for this broadening phenomenon, for each species of particles present 
in this sorting- device there are random switches, with a specific transition rate A;+, from a 
mobile state (in which particles are dragged with a specific velocity v along the chromato- 
graphic column) to an immobile, adsorbed state; they are afterwards randomly desorbed, 
with a characteristic desorbing rate see Fig. El for a schematic representation. 

This stochastic process can be described as 

x{t) = v/2 + at), (24) 

where x{t) designates the position of the particles along the column, and ^{t) is a DMN that 
takes the values ±v/2 with transition rates k±. This results in an asymptotic mean velocity 
of the particles 
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FIG. 3: Schematic representation of a chromatographic column of length Lc- Particles switch at 
random, with transition rate k^, from the mobile state of velocity = v to an adsorbed, immobile 
state (v- = 0), and can return to the "free" state with a transition rate 

and a dispersion of the particles around this drift profile (a "broadening" of the profile) 
given by an effective diffusion coefficient 

The separating efficiency of the chromatographic column is thus determined by its length 
Lc, through the condition that for each type of particles "convection wins over dispersion", 

L > - ^^+^ (27) 

and also by requiring "sufficiently different" asymptotic mean velocities of the parti- 
cles of different species. Note also that reaching the asymptotic regime requires times 
t ^ Tc = 1/ {kj^ + and therefore Lc should be actually much larger than the right-hand 
side of the above equation. 



(h) Measuring reaction rates through electrophoresis. 
In this system, as modeled in Ref. j28[, the jumps (with transition rates k±) between the 
two states of a DMN correspond to a particle undergoing a chemical transformation between 
two configurations, A^^^ and A^'^\ with different electrophoretic mobilities See Fig. 0] 
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FIG. 4: Schematic representation of an electrophoresis experiment. An ensemble of particles 
undergo random transitions between two states, A^^^ and A^"^^ , that have different electrophoretic 
mobilities respectively ;U_. By applying an external electric field E and by measuring the 
mean drift velocity of the particles, as well as the diffusion around the mean drift position, one can 
obtain the values of the transition rates kj- between the states A^^''^\ 

for illustration. Of course, by measuring "statically" the concentrations [A'^^'^-'] of the two 
configurations, one can obtain the ratio of the transition rates k±, since at equilibrium 
= A;_[74^^'']. When applying an external field, one can measure "dynamically" the 
average velocity of the electrophoretic peak. 



{x} = ^ : h 



(28) 



k+ + k. 

(which contains the same information as the equilibrium measurements), but also the dis- 
persion of the particles around this peak, i.e., their effective diffusion coefficient 



^ /c+/c-(/i+ -^„)^ 2 
eff (fc+ + k^Y 

and thus one can determine /c+ and k- separately. 



(29) 
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the motion of 
31|. Applications 



(c) Taylor dispersion. 
In the fifties, Taylor investigated, both theoretically and experimental 
tracers in a Poiseuille fiow in cylindrical configuration, see Refs. 30, 
refer, e.g., to the motion of pollutants in rivers, etc. In the long-time regime, he found that 
the tracers are being dragged downstream along the x-axis of the cylinder, with the mean 
velocity u of the fiow. But besides that, the tracers are also dispersed around this drift peak, 
with an effective diffusion coefficient -Dgff that is inversely proportional to their molecular 
diffusion coefficient D. See the left-hand side of Fig. El for an illustration. A very simple 



Poisseuille flow 



a 



u 



D=D+ 

eff 



V = u + V 

+ 

X = U + ^(t) 

^ = DMN {+ V, kj 



eff 



8k 



2k 



FIG. 5: Schematic representation of a Poiseuille flow in a cylinder (left-hand side of the figure), 
with the expression of the effective diffusion coefficient along the direction of the flow as found 
theoretically by Taylor. The right-hand side of the figure represents a caricature of the Taylor 
dispersion seen as a dichotomous diffusion, see the main text. Indicated are the model stochastic 
process, and the resulting effective diffusion coefficient along the axis of the cylinder. 



model of dichotomous diffusion introduced later, see Ref. [3^, allows to capture the essential 
features of the Taylor dispersion. It consists of tracers that jump at random, with transition 
rates k, between two layers of fluid with velocitis u + V and u — V respectively. This results 
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in an effective diffusion coefficient along the x-axis, -Dgff that is inversely proportional to 
the transition rate k. One realizes that, as in the case of the Taylor dispersion, -Dgff is 
proportional to the typical time that is needed by a particle to sample all the available 
velocities {a^/D for the Taylor ffow, and k^^ for the dichotomous diffusion). Note also the 
divergence of -Dgff when there is no transition between the layers of the fluid (i.e., when 
D for Taylor dispersion, respectively ^ for dichotomous diffusion); indeed, in 
this case particles with different velocities move apart from each other with a ballistic motion. 



(d) Jepsen-McKean gas. 
This is a very simple (although theoretically very productive) model of a classical gas. It 
consists of elastic, hard-point particles that are initially randomly distributed on a line 
(with an average distance A between them), and with randomly distributed initial velocities 



M 



35|. At collisions particles simply 



taking two possible values, +v and —v, see Refs 
exchange trajectories, see Fig. IHlfor a schematic representation. The velocity of a particle is 




average distance X 



FIG. 6: Schematic representation of one realization of the trajectories of the hard-point particles 
of a Jepsen-McKean gas (see main text). The thick line represents the trajectory of a test-particle 
that undergoes a dichotomous diffusion due to the collisions with the other particles. 



thus just x{t) = ^(t), with the DMN ^{t) taking the values ±v with transition rate k = v/X. 
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For this system, the master equation for the probabihty densities P±{x,t) is nothing else 
but Boltzmann's equation (which is exact for this model!), and the probability distribution 
function P(x, t) (that obeys telegrapher's equation) is proportional to the spatial density of 
particles. 



(e) Kubo- Anderson oscillator. 
Finally, an example that has numerous applications in spectroscopy (see, e.g., Ref. 



review), is the so-called "random- frequency oscillator" introduced in Ref s. j37, 
It is described by the stochastic evolution of a phase-like variable, 

U(t) = -i [ujQ + ^(t)] u , 



38, 
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36 



for a 



4G 



4l|. 



(30) 



where, in one of the simplest variants, C,{t) is a DMN ±A with transition rate k. The mean 
value of the phase variable 



(n(t)) = (n(0))(exp —iuj^t 

= (n(0))e~''^«*~'^* 
leads to a power spectrum 



^{t')dt' 



) 



|cos(tVA2 - A;2) + ^ sm{tVA^-k^)\ 
{ \/ A? — k"^ ) 



SiAu) = — 



A-" 



(31) 



(32) 



TT [(ACU)2- A2]2 + 4P(Aw)2 

with Auj = u! — u!q. As illustrated in Fig. [71 there is a change in the shape of the spectrum 
with increasing frequency k of the transition, the so-called motional narrowing. Such a 
random-frequency oscillator can describe, for example, the Larmor precession of a spin in a 
random magnetic field; or the thermal transition of a molecule between configurations with 
different absorbtion frequencies, etc. By measuring the motional narrowing in the power 
spectrum, one can obtain various information on the structure of the system under study. For 
example, from measurements on the NMR spectrum at different temperatures (which means 
for different Arrhenius-like transition rates between different structural configurations), one 
can determine the energy barriers between the various configurations of a molecule - see, 
e.g., two early-day papers of J. A. Pople, Refs. 



Lie VaL lU UO LAJliii 

3. H and 0- 



2. Dichotomous diffusion and Quantum mechanics 

Let us now mention briefly two types of connections with quantum mechanics problems. 
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FIG. 7: Schematic representation of the motional narrowing of the power spectrum of the random- 
frequency oscillator driven by a DMN zizA (see the main text). The spectrum, that is two-peaked 
for low transition rates k of the DMN, becomes progressively single-peaked and narrower with 
increasing k. 

(a) Relativistic extension of the analogy between quantum mechanics and 
Brownian motion. 

As first remarked in Ref. j^l, the telegrapher's equation ()2H) can be converted into the 
Klein-Gordon equation through a simple transformation, that suggests a formal connection 
with relativistic wave equations. More precisely, setting: 

P±{x,t) = e-''iJi,2{x,t) (33) 

in Eq. (j2^, one finds that each of the "components" ijji^2 obeys the Klein-Gordon equation: 

{d^-A'dl-e)^lj,,2 = 0. (34) 
Or, by substituting in the master Eq. (j^n|) . one finds the coupled equations for the compo- 
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nents ipi^2- 

{dt ± Ad^)tlJi,2 = fc^2,i . (35) 
On the other hand, the Dirac equation for a free relativistic particle of rest mass rriQ reads 

(^7^9^ - moc/h)^ = (36) 

(c is the speed of hght, and h the reduced Plancks's constant). In (1 + 1) dimensions 
dfj^ = {c~^dt, dx) and using Weyl's representation 

the Dirac's equation for ip = {ipi, ■ip2) reduces to 

{dt ± c9^)^i,2 = {ttiqc^ / in)i)2,i . (38) 

Of course, these are exactly Eqs. (jS^), provided that we make the following identifications: 

A^c, k^niQC^/ih. (39) 

The factor i that appears above reflects the familiar analytical continuation to "imaginary 
time" that appears in the usual passage from the diffusion equation to the Schrodinger 
equation (or from the diffusion kernel to the quantum mechanics propagator). So, in this 
picture, a Dirac particle in one dimension, with helicity amplitudes tpi^2 moves back and 
forth on a line, at the speed of light (Zitterbewegung!), and at random times it flips both 
the direction of propagation and the chiralit y. 

This analogy was generalized later in Ref. j45| to the case of a velocity-biased dichotomous 
diffusion. The transition rates between the +A state and the —A state are unequal, ^ k^, 
thus resulting in a net drift velocity, see Ref. Q for a detailed discussion of this process. 
The modifications in the master equation and its solutions can be interpreted in terms 
of a Lorentz transformation to a frame moving precisely with this drift velocity. As a 
consequence, in the connection to the Dirac equation this results in a modification of the 
correspondence between the rest mass of the Dirac particle and the frequency of direction 
reversal in the dichotomous diffusion, the latter being corrected by the time-dilatation factor 
corresponding to the drift velocity. 
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The analogy between stochastic differential equations and quantum mechanical waves 
has been developed further in the context of stochastic quantum mechanics (see Ref. j3| 
for some pertinent references). However, many nontrivial open questions still remain (e.g., 
the extension of the analogy between diffusive processes and relativistic wave equations to 
more than one spatial dimension, to cite only an example). 

(b) Quantum random walks and dichotomous diffusion. 

In Ref. one considers a one-dimensional space and time-discrete quantum random 
walker driven by a Hadamard "coin-tossing process". Namely, at each time step the two- 
component wave function ip{n,t) = {ilji{n,t), il)2{n^t)) of the particle on a discrete lattice at 
position n suffers a modification of the chirality and a jump to the neighbour sites, according 
to the rules: 

i)i{n,t+ 1) = -^i)i{n + l,t) + -^i)2{n- l,t) , 

^2(n,t+l) = -^^i(n + l,t) + -^7/;2(n-l,t). (40) 

In the continuum space and time limit, the probability distribution for the quantum particle 
(i.e., the square of the wave function) is shown to obey a hyperbolic equation that is 
similar to telegrapher's equation obtained for a dichotomous diffusion with space-dependent 
transition rates between the two states of the driving DMN. This leads to an asymptotic 
ballistic behavior of the mean square "displacement" of the quantum particle, contrary 
to its classical counterpart (an effect of quantum interferences). The generalization to a 
larger class of unitary transformations of the chirality than the Hadamard coin-tossing will 
lead, in the continuum limit, to a larger class of hyperbolic equations describin g p iecewise 
deterministic motions. Solving these equations is, however, a very difficult task |47|. 

In view of the already-discussed difficulty and thus scarcity of exact results for time- 
dependent problems, but mainly in view of the relevance for practical purposes, we shall 
turn below to the asymptotic, stationary regime of the dichotomous flows. 
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IV. DICHOTOMOUS FLOWS: STATIONARY SOLUTIONS WITHOUT UNSTA- 
BLE CRITICAL POINTS 



The first subsection will be devoted to the definition and general properties of simple 
stationary dichotomous flows on the real axis, in the absence of unstable critical points. We 
discuss afterwards the appearance of noise-induced transitions on the particular example of 
the genetic model. A comparison is made between the effects of the DMN and those of a 
deterministic periodic dichotomous perturbation. In the third paragraph we are considering 
a simple ensemble of coupled dichotomous flows, and analyse the mechanism behind the 
onset of a global instability in this model of a spatially-extended system. The DMN and 
the deterministic periodic forcing are contrasted again in this context. Finally, in the fourth 
subsection we are ready to address the problem of the nonequilibrium phase transitions 
induced by DMN in a mean-fleld type of model. Comparison with the phase transitions 
induced by GWN allows to emphasize speciflc features (multistability, hysteretic behavior, 
etc.) related to the colour of the DMN noise. 



A. Generalities on stationary dichotomous flows 

The vaste majority of the studies on dichotomous flows refer to the stationary, long-time 
behavior. We shall briefly present here the most important, generic results for flows f±{x) 
that are deflned and "sufficiently smooth" (at least continuous) on the whole real axis, 
without any specific periodicity properties, and without unstable critical points. This last 
condition, that avoids important mathematical difficulties (that will be revisited in Sec. V) 
was the only one considered in the "classical" literature on the subject. We will admit it 
throughout this Section. 

Note, however, that each of f±{x) may have, eventually, one stable critical point (of 
course, in view of the supposed continuity and absence of unstable critical points of f±{x), 
no more than one fixed point is allowed for each f±{x)). The only non-trivial situation that 
can therefore be considered in this context appears when each of the altern ate " -I-" and "-" 



210|: 



fiows does have a stable critical point, let us call them x+, respectively x_ 

/±(x±)=0, with /;(x±)<0 (41) 
(the prime denotes the derivative with respect to x). Due to the competition between these 
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attractors, the asymptotic motion of the particles settles down in an alternate flow between 
the two attractors, a process called dynamic stability, which leads to a nontrivial stationary 
probability distribution Pst{x). Thus the attractors define the compact support of Pst{x), 
see Fig. |S] The support depends on the amplitude of the DMN, however it is clear that it 
does not depend on the transition rates. Indeed, due to the exponential distribution of the 
waiting times in each state of DMN, the particle can persist into one of the flows till reaching 
the corresponding attractor, whatever its initial position with respect to this attractor. 











\ Support of PJx) 


X 


\ depends on A \. 




\ does not depend on k 





FIG. 8: The attractors x_ and x+ of the alternate flows f-{x), respectively f+{x) define the 
compact support of the stationary probability distribution Pst{,x) of the dichotomous flow. See the 
main text. 

The stationary master equation for Pst{x) can be easily solved, see e.g. Ref. and leads 
to the following expression (for x_ ^ x ^ a;+): 



Pst{x)dx = M ( , + , , , 1 X 



l/+(^)l 1/4^)1. 
X {kexp[—kT+{x^,x)]} {kexp[—kT_(x+,x)]} 



where 



T±(u,x) 



dz 



(42) 



(43) 



and A/" is a normalization factor. The structure of this expression has a simple intuitive 
interpretation: 
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(a) Particles that are found in the interval dx around x can be either in the +, or in the - 
flow, spending in dx a time that is inversely proportional to their velocity. From here the 
term {dx/\f^{x)\ + dx/\f^{x)\). 

(b) In order to reach the point x, particles: (i) either come from x_ and are driven by 
the flow (towards its attractor); this takes a time T+(x_,x), and the probability for 
the DMN to persist in the + state during this time is {kexp[—kT+{x-,x)]}; (ii) or come 
from x+ and are driven by the f-{x) flow; this takes a time T-{x+,x) and happens with 
probability {A;exp[— A;T_(x+,x)]}. 

Near the attractors, Pst{,x) has a typical behavior 

P.t(x) ~ |x-x±r'-'"/^±("±^ (44) 

which reflects the competition between two time scales, namely that of the switching 
between the two flows and that of the dynamics in the vicinity of the attractors. More 
precisely: (a) If the transition rate k is low {k/\f'^{x±)\ < 1), there is an accumulation 
of particles at the stable fixed point (and this results in an integrable divergence of the 
probability distribution function); (b) If the transition rate k is large, the alternance of 
dynamics is sufficiently efficient in sweeping-out the effect of the attractor. Pgt becomes 
zero at the borders, either with a divergent slope (for 1 < k/\f'^{x±)\ < 2) or with a zero 
slope for A;/|/4(x±)| > 2. 

Another point of interest is the location of the maxima Xm of Pst{x), and their dependence 
on the parameters of the noise. Why are these maxima important? Because (in view of the 
ergodicity of the system) they offer indications on the values of the stochastic variables 
that are most-likely encountered in a finite-time measurement on the system. The equation 
giving the extrema 



f{Xm) - Dg{Xm)g'{Xm) + 



(45) 



9[Xm, 

has several contributions: the first term in the left-hand side corresponds to the determin- 
istic (noiseless) steady-state. The second term is related to the multiplicative nature of the 
DMN {g'{x) 7^ 0), and persists in the limit of a Gaussian white noise (where it is known as 



the "Stratonovich spurious drift" , see, e.g, Ref. 



• 3)- 



Final ly, the last term on the left-hand 



side is due to the finite correlation time of the DMN 
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21l|, and, of course, is absent in the 



GWN-limit. 



The nonlinearity of f±{x) leads to the possibihty of multiple maxima of Pst{x). Moreover, 
by modifying the parameters of the noise, one can vary the position of these maxima, or 
can even create new maxima (that are absent in the absence of the noise). The macroscopic 
state of the system can thus undergo a qualitative change under the influence of the noise. 
Coloured-noise processes can give rise to states that disappear in the limit of a white noise. 
These very simple remarks are at the basis of the celebrated noise-induced transitions, see 
Ref. 0| for a review. Note, however, that this change in the shape of Pst{x) does not 
lead to a breaking of ergodicity (roughly, the initial state of the stochastic system does 
not influence on its asymptotic behavior). Also, sometimes, these noise- induced transitions 
reduce mathematically to a nonlinear change of the stochastic variable. 



B. The genetic model: a case-study of transition induced by DMN 

One of the best candidates to illustrate the concept of noise-induced transition is, without 
doubt, represented by the so-called genetic model, see Refs. and Q. Indeed, in the 
absence of the noise this model exhibits a unique steady state that is stable: the system is 
not capable of any transitions under deterministic conditions. We shall show that, depending 
on the parameters of the noise, new macroscopically observable states (in the sense described 
in the paragraph above) can be generated - i.e., purely noise-induced transitions can take 
place in the system. 

The equation of the model is 

x = (l/2-x) + Ax(l-x), (46) 

where x{t) is the state variable (that takes values between and 1), and A is the control 
parameter which models the coupling of the system to its environment. 

This very simple model was initially introduced on a purely theoretical basis, see Ref. 
A realization of it is given by the mean-field description of the coupled auto-catalytic reac- 
tions: 

h 

A + X + Y ^ 2Y + C (47) 
k2 
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B + X + Y ^ 2X + D (48) 

The reactions conserve the total number of X and Y particles: 

X{t) + Y{t) = N = constant (49) 

Considering 
and 

. _hB + k^D - kiA - kiC 

k,C + k,D ' ^^^^ 

one obtains the genetic equation for the variable x = X/N. The concentrations A, B, 
C, and D are externally-controlled and determine the value of A. 

Later on it was shown that this model can be used to describe quite realistically a mech- 
anism of genetic evolution in a two-genotype population - and this is where the name of 
the model came from (see Ref. 0] for detailed comments). In this context, x represents 
the frequency of one of the two genotypes. The term (1/2 — x) corresponds to a mutation 
between genotypes, that tends to equalize the frequency of their expression. Finally, the 
term Ax(l — x) corresponds to a natural selection mechanism that tends to favor the geno- 
type that is "best adapted" to the environment; A represents the "selection rate", that is 
environment-dependent and that can be either positive or negative. The deterministic (A = 
constant) steady-state is just 



X 



det 



[A-l + (A2 + l)V2]/(2A) (52) 



and, as it was already mentioned, one can easily verify that it is asymptotically, globally 
stable. 

Let us now try to model the effects of a fluctuating environment on the genotype dynam- 
ics. This can be done by assigning a fluctuating "selection rate" A; for example A = ^{t) 
can be a symmetric DMN {±A, k} (such that on the average no genotype is favored by the 
natural selection), see Ref. The corresponding stochastic differential equation 

X = {1/2- x) +^{t)x{l- x) (53) 
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leads to a stationary probability distribution function Pst{x) that can be studied in full 
analytical detail. Putting together the information on the support of Pst{x) (the region 
between the attractors of the alternate "+" and "-" dynamics); on its maxima; on its 
behavior (and that of its derivative, see above) near the borders, one can obtain the "phase 
diagram" of the system in the plane of the parameters k and A of the DMN, see Fig. El 

5 

A 

4 
3 



2 



1 



1 2 3 4 5 ^ 

FIG. 9: The phase diagram of the genetic model driven by a symmetric DMN in the plane of the 
parameters (k, A) of the DMN. The borderlines correspond, respectively, to: (i) A = 2\J k — 1 for 
k^l ; (ii) A = Vk^ - 1 for k ^ 1; (iii) A = k for k ^ 2; and (iv) A = /4 - 1 for A; ^ 2. The 
shape of -Pst(x) for the different regions is represented qualitatively, illustrating the peak-splitting 
and the peak-damping effects, see the main text. 

The simplicity of the stochastic structure of the DMN (that was invoked in the 
Introduction) allows us to decipher the two mechanisms at work in fashioning the shape of 
the stationary probability distribution Pst{x). The first one is a peak-damping mechanism, 
which is a generic disordering effect of the noisy environment. The second mechanism is a 
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peak-splitting mechanism, signature of the two- valued DMN, and source of the noise-induced 
quahtative changes in the shape of Pst{x) (i.e., of the noise- induced transitions). Recall, 
once more, that there is no ergodicity breaking in the system. Note, moreover, the 
disappearance of the signatures of a stochastic behavior for too large or too low transition 
rates of the noise, which is a generic effect for all dichotomous flows. This is very simple 
to explain intuitively: 

(a) In the first case ("large" fc-s) the system "does not have time" to adapt to the 
rapidly-changing instantaneous value of the noise, and the stochastic effects are simply 
smeared out. (From here results the single deterministic peak of Pst{x) in Fig. IHl); 

(b) In the latter case ("small" /c-s) half of the systems of the statistical ensemble are 
evolving along /+(x), and half along /+(x), practically without interchange between these 
subensembles. (From here result the two deterministic peaks of Pst{x) in Fig. IHl) 



i. What is the difference with a dichotomous periodic forcing? 

In this context, people also addressed the following question: what is the difference (if 
any) in the transitions induced by random (DMN) and periodic dichotomous perturbations? 
Let us consider this problem in the context of the genetic model, following Ref. js^, and take 
in Eq. ()5H|1 $,{t) to be a dichotomous periodic forcing as shown in Fig. E3 The stationary 
probability distribution Pstix) (corresponding to random initial conditions in the variable 
of the system and in the phase of the perturbation) is given (with obvious notations) by: 

P..(^)d. = + A_) = i + ^) . (54) 

One notices that its support depends on both the amplitude A and, contrarily to the case 
of the DMN, also on the period T of the perturbation (which limits the time the system 
spends in the "-I-", respectively "-" states). But, more important, Pst{x) is always himodal 
and qualitatively independent of the parameters of the perturbation, see Fig. ^2 This means 
that no transitions are induced by the periodic perturbation. We can infer from this, as 
done in detail in Ref. [s^, the importance of the exponentially rare, "large excursions" of 
the DMN (i.e., long intervals of time when it persists in keeping the same value); these are 
reflected in the low-frequency part of the power spectrum of the DMN perturbation. This 
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FIG. 10: A deterministic periodic dichotomous forcing ^(t) of amplitude A and period T. 




0^1 

FIG. 11: Qualitative profile of the stationary probability distribution Pst{x) for the case of a deter- 
ministic periodic dichotomous forcing ^(t) in the genetic model. We considered two perturbations 
of the same amplitude A and different periods Ti and T2. Pst{x) is always bimodal and its support 
depends on both the amplitude and the period of the perturbation. 

part is missing in the spectral distribution of the deterministic periodic forcing (which is, 
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actually, a succession of 5-peaks), and in some circumstances (like in the genetic model) it 
can be important in determining the overall behavior. 

One is thus tempted to extrapolate and state that it looks like the behavior induced by 
the DMN is "richer" than that induced by a periodic perturbation. We shall question this 
point further with the next case-study, by introducing an example of coupled dichotomous 
flows. This will also allow us to make a first step towards the concept of noise-induced 
nonequilibrium phase transition in spatially-extended systems. 



C. Overdamped parametric oscillators: a simple case-study for perturbation- 
induced instabilities 

Over the past two-three decades there has been an increasing interest in the nonequilib- 
rium behavior and the role of noise on spatially extended systems modeled as ensembles of 
simple dynamical units coupled to each other. Noise was longly-thought to be only a source 
of disorder - as suggested by many day-to-day situations, as well as by equilibrium statis- 
tical mechanics. However, it is now acquired wisdom that in out-of-equilibrium, nonlinear 
systems noise can actually lead to the creation of new, ordered states, i.e., to noise-induced 
phase transitions. These represent a result of the collective, noisy, and generically nonlinear 
evolution of the component units, and are absent in the absence of the noise. Moreover, the 
collective behavior is usually qualitatively different from that of the single dynamical units. 

The first step in the onset of a phase transition is the instability of the reference state, and 
the collective effects are very important at this stage, either by promoting the instability, 
or by preventing/delaying it. We shall illustrate the onset of the instability on the example 
of a system cons istin g of coupled parametric oscillators, which are widely-spread simple 
dynamical units 



212j |. For simplicity, we shall consider only the inertialess case (and we 
refer the reader to Refs. (52, |53|, |54| for the case with inertia, and for further details and 
discussions). 

Once this step overtaken, we can proceed in Sec. IV. D with a more "standard" discussion 
of a phase transition induced by DMN in a system of coupled dynamical flows. We shall 
moreover address specific effects related to the colour of the noise as compared to the GWN 
case. 
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1. A single oscillator 



Let us start by considering first the dynamics of a single unit, namely a single scalar 
variable decaying at a rate that is parametrically modulated, see Ref. js^: 

x{t) = [-l+m]<t)- (55) 

In the spirit of the comparison presented in Sec. IV.B.l, we shall consider ^{t) to be either 
a symmetric DMN {±/l, /c}, or a deterministic periodic perturbation (of given amplitude 
and period) with a randomly uniformly distributed initial phase. 

One can obtain analytically the temporal behavior of the first moment {x{t)) (where (...) 
designates the mean over the realizations of the DMN in the first case, and over the initial 
phase in the case of the deterministic perturbation), with the typical profiles illustrated 
qualitatively in Fig. [T21 




FIG. 12: Qualitative features of the temporal evolution of the first moment {x{t)) of the model 
considered in Eq. ()55() . for both a DMN and a deterministic periodic perturbation. Note in the 
case of the periodic perturbation the transient increase of {x{t)) above its initial value. 

Whatever the parameters of the deterministic periodic perturbation I213I 1 , after a tran- 
sient increase above the initial value, the mean tends asymptotically to zero: the absorbing 
state a; = is a global attractor. 
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Fo r th e case of the DMN, if the amphtude A > ^/2k + 1 then the mean diverges in 



time |214| . although the absorbing state is still a global attractor, i.e., the probability distri- 
bution P{x,t) tends asymptotically to Pst{x) = 6{x). The reason for this counter-intuitive 
behavior has to be looked for into the existence of the extremely rare realizations of the 
DMN that lead to extremely large excursions of x away from zero. Even if the latter ones 
are exponentially few, their weight in the calculation of the mean is exponentially large, and 
can thus finally lead to the reported divergence of the mean. Although it cannot be argued 
that this represents a noise-induced transition in the sense discussed in Sees. IV. A and IV.B, 
it is nevertheless an essential qualitative change in the transient stochastic behavior of the 
system. 

2. Coupled parametric oscillators 

Consider now such identical overdamped oscillators that are coupled in the simplest 
possible way, namely an all-to-all harmonic coupling: 

Xi = [-l + ii{t)]xi - ^ Kij{xi - Xj) , (56) 

j 

with i = 1, ...,N and Kij = K/N. Let us take the thermodynamic limit N ^ oo and write 
down the evolution equation for a generic oscillator (dropping the subscript i for simplicity 



of notation) 215l | : 



x{t) = [-1 + ^{t)]x - K[x - {x{t))] . (57) 

One can then easily deduce the instability border that separates the asymptotic absorption 
regime {x{t)) — * from the asymptotic explosive regime |(x(t))| oo. This is illustrated on 
Fig. ^1 in the plane of the parameters A (amplitude of the perturbation) and K (coupling 
constant), for a fixed value of the transition rate k for the DMN, respectively of the period 
T = l/{2k) for the deterministic forcing. 

For the DMN, this border is simply given by: 



A = Vl + 2k + K ; (58) 

therefore, the origin of the global instability of {x{t)) is very clear in this case: if each 
oscillator is unstable, the mean will also be unstable. However, note that coupling has a 
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FIG. 13: The instability borders in the {K, A) plane for an ensemble of globally, harmonically 
coupled overdamped parametric oscillators, with a DMN, respectively a deterministic periodic 
parametric perturbation (qualitative representation; see the main text). Note that the instability 
is re-entrant with respect to the coupling strength K. 

stabilizing effect in this context, which means that you need a larger amplitude A of the 
noise in order to get unstable the center-of-mass of the oscillators. 

For the periodic modulation, the instability border is given by the following implicit 
equation: 



So, in this example, things look to be more spectacular in the case of the deterministic 
periodic forcing (as compared to the DMN case). Indeed, although almost each individual 
oscillator is asymptotically stable (i.e., x{t) — * with probability almost 1), we have, how- 
ever, a diverging mean. The reason is the existence of the initial transient increase of the 
mean (see the previous paragraph). This is due to the presence of a pool (that is perma- 




(59) 
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nently changing) of "exceptional" individuals that make very large excursions away from 
zero. If the coupling is not too weak, and not too strong either, then it is promoting this 
initial transient increase, and these "exceptional" individuals are thus leading the mean. 
So, in this situation, c oupli ng may have a destabilizing effect! As expected, however, the 



transition is re-entrant 



2161 with respect to the coupling strength K (a too large coupling 



do not allow for large excursions; while a too weak coupling does not allow the exceptional 
individuals to pass their role to the others, i.e., the permanent refreshing of the leading 
pool). 

This simple example allowed us to make an important step in understanding the origin of 
the onset of a global instability that may lead to a phase transition in an extended system: 
it is an initial, transient, local instability in the system that is promoted and is "not let to 
die out" by the coupling between the dynamical units of the system. As discussed in a very 



48[, this is a generic mechanism behind the onset of nonequilibrium 



pedagogical way i n Ref . 
phase transitions This mechanism (although we shall not enter into further details) 

is also at work in the example we shall present in the next paragraph. 



D. Phase transitions induced by noise: a model and a comparison between DMN 
and GWN 

This model corresponds to a mean-field coupling between dichotomous flows driven mul- 
tiplicatively by the DMN ^{t). The corresponding equation for the self-averaging stochastic 
variable x{t) is written: 

x{t) = fix) + g{x)m - K{x - (x)) . (60) 

The stationary probability density depends in an intricate way on the mean value (x), 
namely 

Pst{x;{x)) ~ ( 1^ / , + ^ 



\Uix;{x))\ \f-{x;{x))\ 



X exp 

where 



dz dz 
+ 



(61) 



U{z-{x)) f4^;{x)), 
f±{x; {x)) = fix) ± Agix) - Kix - (x)) . (62) 
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The support of Pst{x\ (x)) is determined by x± (with, for example, x_ ^ x ^ which are 
also functions of (x) determined by: 



/±(^±;(x)) = o. 

It follows therefore that the self-consistency condition for the mean: 

(x) = dxx Pst{x; {x)) 



(63) 



(64) 



is highly nonlinear in (x) and can thus, in principle, admit multiple solutions 218[. It 
results the possibility of true ergodicity and symmetry-breaking phase transitions, with the 
asymptotic shape of the probability distribution dependent on the initial conditions. In this 
model, the phase transition takes place between a disordered phase with (x) = 0, and an 
ordered phase with (x) ^ 0. These nonequilibrium phase transitions are shown to exhibit 
characteristics that are similar to second-order equilibrium phase transitions 

0, Q> 

with the mean (x) playing the role of an order parameter. 

For concretness, we shall consider the following expressions for /(x) and g{x): 



-xd 



X 



2\2 



and g{x) = 1 + x^ 



(65) 



This will allow to compare this model, s ee R ef . 



which represents one of the first models 



with the situation when ^{t) is a GWN, 
219l | introduced in the literature in order to describe 



a nonequilibrium noise-induced phase transition, see Refs. 



Following the above-cited references 



57 
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3- 



22C| , in Fig. we represented qualitatively, the 



phase diagram of the model in the plane of the parameters K (the coupling constant) and 
D (the intensity of the noise), both for the DMN {D = /2k) and a GWN. In both cases 
one obtains ordered and disordered phases and transition lines between them, and also the 
phenomenon of re- entrance with respect to the intensity D of the noise. 

But, besides these, DMN also induces a multistahility regime of coexistence of two stable 
phases, one ordered and one disordered. This phenomenon is absent for the GWN, i.e., it is 
entirely induced by the finite correlation time (colour) of the noise. Of course, connected to 
this multistability, one encounters a hysteretic behavior of the order parameter (x). Moreover, 
in the case of the DMN one also obtains a re-entrance with respect to the coupling strength 
K, that does not appear for the DMN. 

So the colour of the DMN noise can alter significantly the characteristics of the phase 
transition as compared to the GWN case. 
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DISORDERED 




FIG. 14: Qualitative phase diagram in the plane D (intensity of the noise) and K (coupling 
constant) for the mean-field models described in the main text, equations (|6U() . H65|) . Upper panel: 
^{t) is a DMN with a fixed value of the transition rate k. Lower panel: ^(t) is a GWN. In both 
cases the transition order-disorder is re-entrant with respect to the noise intensity D. Note in the 
case of the DMN the multistability regime, as well as the re-entrance of the phase transition with 
respect to the coupling strength K; both effects are absent in the case of a GWN. 
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V. DICHOTOMOUS FLOWS: STATIONARY SOLUTIONS WITH UNSTABLE 
CRITICAL POINTS 



A. Generalities 

The problem of the unstable critical points of the asymptotic dynamics was essentially 
raised in the context of the existence of a directed stationary flow (e.g., ratchet-like) in the 
system, (x) ^ 0. This is a physical situation that gave rise to a lot of interest and research, 
since it represents one of the paradigms of out-of-equilibrium systems: obtaining directed 
motion (i.e., useful work) "out of fluctuations", a situation that has to be contrasted with 
the equilibrium one, as encoded in the second principle of thermodynamics. The asymptotic 
value (x) is thus the quantity of main interest in this respect. 

In order to understand the peculiarities related to the existence of unstable critical points, 
let us go back to a general dichotomous flow, 

x{t) = fix) +gix)m- (66) 

It is clear that any systematic asymptotic drift is impossible as long as we consider (as we 
did till now) open boundary conditions and/or only stable critical points of the alternate 
f±{x) dynamics. 

One thus needs a periodic system: 

f±{x + L)=f^{x), (67) 

with L the spatial period. But this is not enough yet in order to have a directed current. 
One also needs the breaking of the detailed balance (i.e., the fact that the system is driven 
out-of-equilibrium, and thus directed current "out-of-noise" is not ruled out by the second 
principle of thermodynamics); and also a breaking of the spatial inversion symmetry (so 
that current is not ruled-out by Curie's general symmetry principle). These conditions are 



discussed in detail in the review article Ref. 



6^, 



see also Sec. V.C below. 



But when f±{x) are periodic (and at least continuous over one spatial period), then critical 
points (if any) appear in pairs; therefore, the presence of stable critical points automatically 
implies the presence of an equal number of unstable critical points. 

The physics and the mathematics of the problem are completely different when the asymp- 
totic dynamics allows the "crossing" of the unstable fixed points (i.e., the existence of a 
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directed current in the system) as compared to the case when no such points are present or 
"crossed" . 

A very simple illustration of the changes that may appear in the physics of the problem 
when unstable fixed points are "crossed" is given by the following example, see Fig. ^| Con- 
sider an overdamped particle in a symmetric periodic potential V{x) = Vqcos(2itx/L + (p), 
that switches dichotomically between ±V{x). In the absence of an external force, the dynam- 
ics is restricted to the interval between two fixed points, [L(A;7r — (/?)/27r, L{{k + 1)71 — Lp)/27r] 
{k integer). Thus, as far as the right-left symmetry is not broken, there is no current flowing 
through the system, see the upper panel of the figure. Suppose now that we apply a small 
external force |-F| < 27rVo/// that breaks right-left symmetry but cannot induce "escape" 
from a finite interval in neither of the separate f± = ^2'kVq/L sin(27rx/L + ip) + F dynamics 
(corresponding to the effective potentials ±V{x) — Fx). However, switching between these 
dynamics allows "crossing" of the unstable fixed points, and thus the appearance of running 
solutions with a finite average velocity. See the lower panel of Fig. fT5l 

From the point of view of the mathematics, the presence of unstable fixed points induces 
some serious difficulties in the calculation of the asymptotic probability distribution function 
Pst{x). This is the main reason why, with a few exceptions, see Refs. jl?! . 61, [g^ (and 
also Refs. for the related problem of the mean- first passage time), the problem of 

dichotomous fiows with unstable critical points was generally not approached. We have 
recently made progress towards identifying the source of spurious divergences that arise in 
the usual analytical treatment of the problem, see Refs. 000, 

and we are now in the 

position to consider this situation as well. 



B. Solution to the mathematical difficulties 



Consider thus a periodic dichotomous fiow /±(x), with an asymptotic state characterized 
by a nonzero stationary fiow (x) ^ through the system. One notices (see Ref. for 
further details) that the master equation for the stationary probability distribution function 
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FIG. 15: "Crossing" unstable critical points in the asymptotic dynamics of a dichotomous flow 
allows for a directed current in the system when a small symmetry-breaking force F is applied. 
See the main text for further details. 
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Pst{x): 

[U{x)f4x)] P'Jx) + - (/+/_)(ln|/+ - /_!)' + k{U + /-)] Pstix) 



L 



2k 



f+-f^ 



(68) 



becomes singular at the critical points of f±{x). The crucial point of the problem resides in 
finding the correct solution to this equation, i.e., the one that has acceptable mathematical 
and physical properties (see below, and also Ref. 6^). A blind application of the method of 
variation of parameters to this differential equation leads to a solution of the form: 

U{x)-f_{x) 



Pst{x) = M 



[CG{x, Xq) + K{x, Xq] x)] 



(69) 



Uix)f4x) 

where C is a constant of integration that arises from the general solution to the homogeneous 
part of Eq. ()68|). the second contribution is the particular solution of the full inhomogeneous 
equation, xq is an arbitrary point in [0, L), and we have defined the functions: 



G{u,v) 
K{u, V] w) 



exp 

dz 
xsgn 



dz 
2k 



1 1 

+ 



U{z) + f-{z) 



+ 



[Uiz)-f4z) \2[Uiz)-f.iz)] 



G{w, z) 



(70) 



_U{z)~f.{z)_ 
(sgn is the signum function). 

The point is that using a unique integration constant C over the whole period [0, L] 
is not the right thing to do, since it leads to unphysical divergences in the expression of 
Pst{x). More precisely, one has: 



a). Integrable singularities at the stable fixed points Xg of /+ or /_: 

P.,(a:)~|a:-x.r^+'=/IA'±)(-=)l, (71) 

provided that the transition rate k < \f'^j^-^{xs)\. Of course, these are causing no problems, 
and are in agreement with the intuitive image that there may be an accumulation of the 
particles at the stable critical point of one of the two dynamics, provided that the switch to 
the alternate dynamics is not sufficiently rapid to "sweap" particles away from this attractor. 
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b). Non-integrable singularities at the unstable fixed points Xu of /+ or /_: 

|a:-a:„r^"'^/IA'±)(-)l. (72) 

These are, of course, meaningless and one has to find a method to avoid their appearance. 



The fundamental idea, as explained in detail in Ref. , is then to use different integration 
constants in the different intervals between fixed points, and then to adjust these constants 
such that Pst{x) acquires the right behavior, namely: 

• Pst{x) is continuous or has at most integrable singularities in [0, L] 

• The fact that the probability density is periodic: 

Pst{x + L) = Pst{x) , (73) 

with the eventual exception of some singularity points (see the simple example below). 
This condition is determined, of course, by the supposed periodicity of the dichotomous 
flow. 

• The usual normalization condition one imposes to a probability density (in this case, 
restricted to a spatial period): 

r-L 

Pst{x)dx = 1 (74) 



It can be shown that, under rather general conditions |22ll | these requirements ensure the 
existence and uniquenness of a well-defined stationary periodic probability density. 

In order to understand the mathematical mechanism involved in the elimination of the 
unphysical divergences appearing at the unstable critical points of the dynamics, let us 
consider the simplest possible situation, namely when both f±{x) are continuous over the 
spatial period, and only one of the two alternate flows has two critical points. For example, 
see Fig. Uni f-{x) has no fixed points, while f+{x) has a stable Xs and an unstable x„ critical 
points (to fix ideas, suppose Xg < Xu)- 

Consider the expression of Pst{x) in Eq. ()69|). for which we shall choose different inte- 
gration constants in each of the separate intervals [0,a;s), (a;s,a;„), and (xu,L] between the 
fixed points. There is exactly one choice of this constant valid for both {xg^Xu) and {xu,L) 
such that the divergence at Xu is removed, namely C = —K{xu,Xo]Xo)] and another choice 
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FIG. 16: Qualitative representation of the "+" velocity profile f+{x) = f^{x + L) of a dichotomous 
flow, exhibiting two critical points: Xg that is stable, and x^ that is unstable. See the main text 
for further details. 

valid in the interval [0, Xg) that ensures the required continuity and periodicity of P{x). The 
acceptable expression for the probability density is therefore found to be: 



P.Jx) 



{ M 

L 

(i) 
L 



U{x)-f.{x) 



Uix) + f4x) 

U{x)-f.{x) 



[K{L,Xu;L)G{x,0) + K{x,0;xo)] for xe[0,Xs) 



(75) 



K{x^ Xiii x^ , 



for X e (xs, L). 



Uix) + f.{x) 

These expressions can be further simplified if one takes as the basic period not [0, L], but 
[xs,Xs + L]. Then the simple- looking, "compact" expression 



PJx) 



L 



U{x)-f.{x) 



K{x^ Xn, x) 



(76) 



holds throughout this new basic period. Moreover, Pst{x) meets all the requirements enumer- 
ated above. In particular, let us check its behavior at the fixed points Xi.2. For x = Xu (the 
unstable fixed point that caused problems before!), the above expression of Pst{x) presents 
an indeterminacy of the type "0/0": by applying Hospital's rule one simply finds that Pst{x) 
is continuous at the unstable fixed point: 

{x) 2k/tl{xu) + 1 



lim PJx 



L f_{xu)[k/f+{xu) + l] 



(77) 
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The behavior at the stable fixed point Xg is continuous 

{i) 2A;/|/;(x,)| 



(78) 



for k/\f'^{xs)\ > 1, while it has a power-law integrable divergence for k/\f^{xs)\ < 1, and 
a marginal logarithmic divergence for k/\f'_^{xs)\ = 1. One also notices the periodicity of 
Pst{x) (except at the eventual singularity point Xs). 

Imposing the normalization of Pst{x) over one spatial period, one obtains finally the 
expression of the asymptotic mean velocity through the system, which is the most important 
quantity for most practical purposes: 



L 



Xs+L 



dx 



U{x)-f.{x) 



2k 



U{x)f^{x) 



dz sgn 



/+(^)/-(^) 



U{z)-f4z) \2[U{z)-f4z)] 



r 






). 


exp 











(79) 



This mathematical reasoning can be generalized to any type of combination of critical 
points of the alternate dynamics of the dichotomous fiow, as shown in detail in the above- 
mentioned references, and we shall illustrate it on three examples below. 

The first one refers to an interesting physical situation, namely that of hypersensitive 
response, that is actually in tight connection with the system already described qualitatively 
in Fig. El The second one referes to a rocking ratchet, and the third one is an important 
particular realization of such a ratchet, namely a stochastic Stokes' drift effect. 



C. Nonlinear and hypersensitive response with DMN 



Generally and somehow loosely speaking, the term hypersensitive response referes to a 
large and highly-nonlinear response of a noisy, out-of-equilibrium system to a small, directed 



external forcing. This phenomenon was discovered rather recently, and a 



given to several of its variants, both theoretical 
and experimentally, see Refs. |77L 



22l,yisi|. 



ly, see Refs. 



70 



ot of attention was 



We have recently introduced a simple model of dichotomous fiow that exhibits such a 
hypersensitive behavior, see Refs. and [g^I- It describes an overdamped particle that 
switches dichotomically between a symmetric potential V{x) and its negative, as represented 
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schematically in Fig. ^| When the symmetry of the system is sli ghtly broken by a small 



directed external force F, the system responds with a nonlinear drift 



222l | . The dynamics can 



be described by the following stochastic equation (with the DMN acting multiplicatively) : 



X = F + ^{t)v{x) 



(80) 



where v{x) = —V'{x), with v{x) = v{x + L), and (through a rescaling of v{x)) the DMN 

m = ±1- 



(a) When the external force is sufficiently large, there is no fixed point in either f±{x) 
dynamics [F"^ — v'^{x) ^ for any x G [0,L)]. By integrating the stationary master equa- 
tion ()68p corresponding to Eq. ()80|) . one obtains the following expression for the stationary 
probability density, 

fX+L 



PJx) = ^ < 1 + 



v{x) 



dz v'{z) exp 



— dw 



2kF 



p2 _ y'^iiu) 



LF 



[_p2 _ ^;2(^3,^j J gxp 



dz- 



2kF 



> . 



(81) 



Jo F^-v\z)_ 

By imposing the normalization condition of Pst{x) over [0, L), one obtains finally the 
asymptotic mean velocity: 



F 



p2 _ ip(x) 



x+L 



dz v'{z) exp 



2kF 

dw- 



p2 _ 



-1 



L < exp 



dz 



2kF 



F^-v^z) 



(82) 



(b) Let us consider the more interesting case of small forcing, when the asymptotic dy- 
namics has critical points. In order to fix ideas (and without losing any relevant element), we 
take v{x) continuously decreasing in [0, L/2] and symmetric about L/2, v{x + L/2) = —v{x). 
Then Pst{x + L/2) = Pst{x), which allows us to concentrate on a half-period. In this case, 
the "-" dynamics has an unstable fixed point Xu, and the dynamics has a stable critical 
point Xs (with Xg > x„) in [0, L/2]. According to the general discussion in the preceding 
section, one obtains the following physically acceptable solution in the interval [xs — L/2, Xs] 
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(that can be afterwards extended by periodicity to the whole real axis): 



PJx) 



vix] 



LF\ \F^-v^{x) 



I dz sgn [F^ - v'^^z)] v\z) 

J X,, 



X exp 



\ F"^ — f 2(w) 



At the unstable fixed point Xu, the probability density is continuous, 

(x) 

lim Pst{x) = lim Pst{x) 



LFil- 



(83) 



(84) 



2{k/\v'{xu)\ + l) 

At the stable fixed point Xg, depending on the transition rate k, the probability density is 
either continuous, 



lim PJx 



lim Pstix) 

x\{xs-L/2) 



(x) 



LF<1 



(85) 



2{k/\v'{x.,)\-l) 

(for k/\v'{xs)\ > 1), or divergent but integrable (for k/\v'{xs)\ ^ 1). It is the presence of 
these fixed points, and in particular the divergences of Pst{x) that cause a highly nonlinear 
conductivity of the system, as discussed below. 

Finally, from the normalization of Pst{x), the average asymptotic velocity is obtained as 



F 



2 
L 



dx 



Vix) 



Xs-L/2 



_p2 _ ^;2(^2;) 



/ dz Sgn [F^ — ^^(2)] v'{z) 

J Xu 



X exp 



dw- 



2kF 



(86) 



p2 _ ^S^^'J 

These results for Pgt and the mean current are general and exact. However, they still 
involve triple integrals, and are too complicated to offer a picture of what is going on in 
the system. We shall thus consider further the particular case of a piecewise profile of v{x), 
as represented in Fig. El In this case, the integrals can be evaluated explicitely, and it is 
found that the behavior of the system is extremely rich. The response (x) to the external 
perturbation F is highly-dependent, in a non-monotonic way, on the transition rate k of 
the DMN, more precisely on the control parameter a = Ik/vo (for the significance of / and 
Wo refer to Fig. ITTj) . One notices the existence of four different regimes for the response, as 
illustrated in Fig. | 
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FIG. 17: Piecewise linear profile v{x) for the hypersensitive response model, see Eq. (|8U() in the 
main text. A small applied force F induces critical points in both "+" and dynamics {x^ is 
an unstable fixed point of the "-" dynamics, while Xs is a stable fixed point of the "+" dynamics). 
Note the symmetry of the system with respect to x = L/2. 

(a) A first trivial linear response regime corresponds to very high applied forces 
F/vq ^ 1, when the details of the substrate potential ±\^(x) are "forgotten", and (i) ~ F. 
All curves in Fig. approach this limit with increasing F. 

(b) A second linear response regime (x) ~ F appears when a ^ 1, i.e., for very high 
transition rate of the DMN, such that the effects of the fluctuating forces are smeared out. 
This regime is visible on Fig. for a = 1. 

In none of these regime is the response dependent on the characteristics of the DMN. 
The following two regimes are, on the contrary, far from trivial and appear only in the 
presence of critical points of the alternate f±{x) dynamics. 

(c) The adiabatic regime of constant response appears for very slow switching rates /c, 
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O a = 0.01 
□ a = 0.1 
* a = 1 



FIG. 18: The mean asymptotic velocity {x)/vq as a function of the external driving F/vq for 
different values of the control parameter a = Ik/vQ (for the meaning of / and uq, see Fig. I17|) . 
The solid lines are the corresponding result of the theory, and the symbols represent the result 
of averaging over numerical simulations of the dynamics of an ensemble of 20000 particles. The 
dashed line corresponds to the linear response {x) = F. There are four different regimes for the 
response of the system to the external forcing F/vq, see the main text. The inset is a detail of the 
region around the origin (corresponding to the hyper-nonlinear regime). We are grateful to Prof. 



R. Kawai for providing us the data for this plot. See also Fig. 5 in Ref. 



67|. 



more precisely when in-between two flips of the potenatial (refer to Fig. ITH|) the particles 
have enough time to move between two succesive extrema of the potential, and eventually 
to wait in a minimum of the potential till the next flip, that will put them in motion again. 
Therefore, the condition for this regime is that the average time between switches is 
much longer than the typical escape time from a region close to a maximum of the potential, 
r ~ —{l/vQ)lnf; therefore: 1 > / ^ exp(— 1/a). Then the mean velocity is simply half of 
the spatial period of the substrate potential divided by the mean switching time, (i.e., it is 
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independent of the applied force F and is directly proportional to k): 



{x) ^ Ik/vo . (87) 
This regime is well seen on Fig. ^Jfor a = 0.01. 



(d) Finally, the hyper-nonlinear regime which is realized for small forcing, / < 
exp(— 1/a) <^ 1. In this case, the particles manage to advance to the next minimum of 
the potential only in the exponentially rare cases when the DMN persists in the same state 
for sufficiently long time, much longer than both and r (see again Fig. and see above 
for the meaning of r). The mean velocity then falls rapidly to zero with decreasing F: 

" 8Pk lAF/vo) ' ^^^^ 
i.e., it is inversely proportional to k, and the corresponding diverging susceptibility 

d{x) 



X 



dF 



oo (89) 

F=0 



indicates the highly-nonlinear and sensitive character of the response in this region. This 
regime appears for all the values of a and sufficiently small F, as seen on the inset of Fig.lTHl 
We are therefore again in a situation that is contrary to the intuition and to what is 
usually encountered in equilibrium systems, namely a strongly nonlinear response for small 
forcing, and a linear response for large forcing. 



D. Ratchets with DMN 



One of the paradigms of out-of-equilibrium system (with an overwhelming literature 
these last years) is the ratchet effect. As it was already briefly mentioned above, a ratchet 
is, roughly speaking, a device that allows to get work (i.e., directed transport) out of fluc- 
tuations. Although one can think of macroscopic ratchets (e.g., self-winding wrist-watches, 
wind-mills), more interesting from the conceptual point of view are the microscopic rec- 
tifiers, for which microscopic thermal fluctuations are relevant. Indeed, while the second 
law of thermodynamics rules out directed transpor t (ap art from transients) in a spatially- 
periodic system in contact with a single heat bath j223|, there is no such fundamental law 
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that prohibits stationary directed transport in a system driven out-of-equihbrium by a de- 
terministic or stochastic forcing. Such a driving forcing can be provided, for example, by a 
DMN that can act either multiphcatively, or additively. 

Besides the breaking of detailed balance, a fu rther indispensable requirement for directed 



transport is breaking of spatial symmetry 



224j . see Ref. 



60[. There are three main possi- 



ble mechanisms of symmetry-breaking, namely (i) a built-in asymmetry of the system (in 
the absence of the driving perturbation); (ii) an asymmetry induced by the perturbation; 
(iii) a dynamically-induced asymmetry, as a collective effect, through an out-of-equilibrium 
symmetry-breaking phase transition. 

The case of an out-of-equilibrium driving by a multiplicative DMN corresponds to the so- 
called flashing ratchet: generically, an overdamped Brownian particle) jumps dichotomously, 
at random, between two asymmetric periodic potentials V±{x): 



i:(t) = -V\x)[l+m+^GWNit) 



(90) 



where ^(t) is the DMN ±A with transition rate k, C,gwn is a Gaussian white noise, and, of 
course, V±{x) = V{x){l ± A). The particular case of V-,{x) = 0, i.e., a flat potential corre- 
sponding to a free diffusion in the "-" dynamics, is called on- off ratchet. This results in a net 
flow of the particles, in a direction that is determined by the asymmetry of V{x). Various 
models, aspects, and experimental realizations of flash ing or on-off ratchets, including some- 
times the effect of inertia, were discussed in Refs. 
see also Ref. 6^ . 

Systems driven out of equilibrium by an additive DMN belong to the class of the so-called 
rocking ratchets: an asymmetric basic potential V{x) is rocked by a zero- mean additive force 
(a DMN ^(t) in the cases of interest to us): 



x{t) = -V'{x) +^{t)+ eventually ^GWN{t) ■ 



(91) 



This leads generically to an asymmetry in the nonlinear response of the system, and thus to 
a systematic (directed) motion, be it in the presence or in the absence of a thermal noise. 
Inertia of particles was also find to have an important effect on the direction of the drift. 
The literature on various model-rea 
a few references, IGJJ 



and also Ref. 



3 



85 



90 



92 



izations and app hca tions is hu^e, and we cit e her e only 



96 



97,^ 



99 



100 



101 



102 



103 



104 



10,11107^. 



for further examples. 
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As an illustration, we propose here a very simple analytically solvable model of a rocking 
ratchet see Ref. for a detailed discussion. It is described by the following stochastic 
differential equation: 

x{t) = fix)+m, (92) 

with an additive and asymmetric DMN ^(t), that takes the values ±A± with transition rate 
k between these states. In order to fix ideas, we shall suppose A_ > > 0. Here 

f +/i , X e [0, Li) , ^ 

f{x) = -V'{x) = { (93) 

[-f2, xe [Li,Li + L2) 

with /(x) = f{x + L) , L = Li + L2, and < /2 < fi- This corresponds to an overdamped 
particle gliding in a rocked sawtooth potential, as depicted qualitatively in Fig. ^| 




L=Lj+L^ X 2L 

FIG. 19: Effective potentials for the rocking-ratchet model in Eq. (|92j) . Depending on the values 
iA± of the DMN forcing, one may have running solutions in both fj- dynamics (the solid lines 
V{x) =p A±x), or running solutions in only one of the alternate dynamics (dashed lines), or no 
running solutions at all. We also represented the unperturbed basic potential V{x). 



It is obvious that three distinct situations are possible, depending on the values ±A± of 
the DMN. In all these cases one can obtain closed analytical expressions for the stationary 

52 



probability density Pst{x) and the mean asymptotic velocity (x). We refer the reader to 
Ref. 66[ for the exact results, while here we shall comment on a few features. One can 
have: 



(a) A regime of strong forcing, when there is no critical point in any of the alternate 
f±{x) dynamics, and running solutions appear for both tilts. With our conventions, this 
corresponds to A_ > fi and > f^- There results a non-zero current through the system, 
determined by the interplay between the characteristics of the noise and those of the basic 
potential Vi^x) (in particular, its bias, if any). 

One can also consider the GWN limit, for which already known results |l06j | are recovered 
in a very simple way. In particular, the current through the system is strictly detemined by 
the bias of V{x\ such that, when the deterministic potential is unbiased, one recovers the 
equilibrium state with a Boltzmann distribution and no current. 



(b) The regime of intermediate forcing, when there are critical points in only one of the 
alternate dynamics. In our case, this happens when A- > fi and A+ < /2, and only the 
"+" dynamics has critical points. It is obvious that the sign of the flow is determined by 
that of the dynamics without fixed points ("-" in our case); sometimes the current may thus 
be opposite to the bias of the basic potential V{x). 

One notices the possibility of current reversal when varying the amplitude of the of the 
noise (at fixed k), i.e., when passing from regime (a) to regime (b). 

As a limiting case of both (a) and (b) regimes, one can consider the white shot-noise 
limit (see Sec. I. A), and recovers easily the results of Ref. 



. 3- 



(c) Finally, the regime of weak forcing, when both alternate dynamics have critical points. 
There is not too much interest in it, since there is no flow through the system. Additional 
thermal noise is needed to generate rectified motion, and this proble m has been a ddressed 
(mainly in the case of adiabatically slow forcing) in Refs. 



this problem has been a c 

Q H • 



E. Stochastic Stokes' drift 



Stokes' drift refers to the systematic motion that a tracer acquires in a viscous fluid 
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unde r the action of a longitudinal wave traveling through this fluid, see the original refer- 
ence llOQ^ . The deterministic effect (that does not account for the fluctuations or perturba- 
tions in t he sy stem) has a simple intuitive explanation, as illustrated through the example 
of Fig. 1201 ml- Consider a longitudinal square-like wave of wavelength L, propagating with 
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H 









v^ = b\ 




f=bv 


U2 


L 








f=-bv 






x-vt 











FIG. 20: Schematic representation of the deterministic Stokes' drift for an overdamped particle 
driven by a longitudinal square-like wave, see the main text. 



velocity and an overdamped tracer particle, that is entrained with a force f = x = bv 
while in the crest part of the wave, and f = x = —bv while in the trough part (with 
< 6 < 1 the situation of physical relevance). The suspended particle spends a longer time 
in the regions of the wave train where it is driven in the direction of propagation of the wave, 
namely t = L/[2{1 — b)v], than the time it spends in those regions where the drag force acts 
in the opposite direction, namely t = L/[2{1 + b)v]. Therefore, the particle is driven on the 
average in the direction of the wave propagation, with vq = b^v, the deterministic value of 
the Stokes' drift. This effect has been studied in various practical contexts, ranging from 
the motion of tracers in meteorology and oceanography, to the doping impurities in crystal 



growth, see the citations in Ref s. 167 
Recent studies, see Refs. Him 



lid- 



111 



112| | and references therein, show the importance 



the stochastic effects may have on Stokes' drift. The thermal diffusion of the dragged par- 
ticles, as well as the application of a coloured external perturbation modify markedly both 



54 



the direction and the mag nitude of the drift velocity. 



We introduced 



11C| a very simple, analytically tractable model for a stochastic Stokes' 



drift, described by a dichotomous flow as: 

x{t) = f{x-vt)+m. (94) 

Here f{x — vt) corresponds to the block-wave represented in Fig. 1201 and ^{t) is a symmetric 
DMN of values ±A and transition rate k. One can perform a simple transformation of 
variables (which corresponds to going to the wave co-moving frame), y = x — vt, through 
which the model can be mapped onto a rocking ratchet problem (as described in the previous 
section, with an asymmetric basic sawtooth potential and an additive DMN): 

yit) = F{y)+at), (95) 

with F{y) = -(1 - b)v for y e [0, L/2) and F{y) = -(1 + b)v for y e [L/2, L). 

As discussed previously, the behavior of the system, in particular the solution of the 
associated master equation for the stationary probability density Pst{x) and the asymptotic 
drift velocity (y) = (x) — f , depend on whether or not there are critical points in the 
dichotomous dynamics. There are two important effects that appear due to the stochastic 
DMN forcing: (i) the enhancement of the drift as compared to its deterministic value : (ii ) 
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110| 



the possibility of drift reversal when modifying the amplitude of he noise. Refer to 
for the detailed calculations. 

Also, noise induces a nonlinear dependence of the drift on the amplitude of the wave. 
Therefore, if several waves are present, their contributions are not additive^ which is a generic 
feature of stochastic Stokes' drift, contrary to its deterministic counterpart. In particular, as 
illustrated qualitatively in Fig. EH if two orthogonally-propagating but otherwise identical 
waves are present, one can induce a significant change in the direction and magnitude of the 
resulting drift simply by changing the transition rate k of the DMN. This is an effect that 
may have important practical applications, e.g., in directing doping impurities in crystal 
growth. 
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^ — — 







FIG. 21: Schematic representation of the nonadditive character of the stochastic Stokes' drift. 
Consider an overdamped tracer under the action of two identical square waves fi and /2 (thick 
hnes), propagating in orthogonal directions, as well as a DMN (thick dashed line). DMN is taking 
the values zizA and is acting along a direction that does not coincide with the bisecting line of 
the two waves /i and /i. The direction and the magnitude of the resulting drift velocity (thin 
lines) change significantly with the transition rate k of the DMN. k = infinity corresponds to the 
deterministic, noiseless limit of linear superposition of Stokes' drift. 

VI. ESCAPE PROBLEMS FOR SYSTEMS DRIVEN BY DMN 
A. Mean first-passage times for diciiotomous flows 



The mean first-passage time (MFPT) represents the mean value of the time at which a 
stochastic variable, starting at a given initial value, reaches a pre-assigned threshold value 
for the first time. It is a concept with many applications in physics, chemistry, engineer- 
ing - ranging from the decaying of metastable and unstable states, nucleation processes, 
chemical reaction rates, neuron dynamics, self-organized criticality, dynamics of spin sys- 
tems, diffusion-limit ed a ggregation, general stochastic systems with absorbing states, etc., 
as discussed in Ref. 113 1. 
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MFPT expressions were obtained in closed analytical form for some particular Markovian 
and non-Markovian stochastic processes, including one- dimensional Fokker-Planck processes, 
continuous-time random walks or persistent random walks with nearest and next-to-nea rest 



115 



116 



117 



118 . 



llflj for 



neighbour jumps, and birth- and-death processes, see Refs. 
some examples. 

For general non-Marko vian processes the problem of the MFPT is delicate and intricate. 



as spelled out first in Ref. 



1201 ]. However, for general dichotomous flows one can obtain exact 



results, using various approaches and tech niques (backward equations, s tochastic trajectory 
counting and analysis), see Refs. 



131 



132L laj- 



3 and tech niqu i 

3. HE.H, 



122L 



12,1 



124 



12,51 



12a 



1271 



isxic trajectory 



Consider an overdamped particle that starts at t = in inside some interval [xa, xb] 
of the real axis, and being driven by the dichotomous flow x{t) = f{x) + g{x)C,{t). Denote 
by T-t(xo) the MFPT corresponding to the particle leaving the interval [xa, xb], provided 
that the initial value of the DMN ^(t = 0) was ±A, respectively. The coupled equations for 
T±{xo) are readily found to be: 



[f(xo) + Ag{xo)]^^^^-kiT, 



[/(xo) - Ag{xo)] 



dxQ 
dT_{xo) 

dXn 



-1, 
-1. 



(96) 
(97) 



The true difficulty here consists in assigning the correct boundary conditions, corresponding 
either to absorbing or to (instantaneously) reflecting boundaries, and also in treating the 
critical points of the alternate and "-" dynamics. For further details see the above-cited 
references. 

The particular case of the so-called bistability driven by DMN, when f{x) de rives 



a bistabl e potentia l Vjx, 



135 



gtapi e pot i 



138 



139 



mi 



rom 



x) = —V'{x), received a lot of attention, see Refs. 
140|. In these systems the escape over the potential barrier out 
of the attraction domain of one of the two minima of the bistable potential is driven by 
an external additive or multiplicative DMN. Consider the interval [xa,^;^] around a stable 
state Xs of V{x) (i.e., f{xs) = 0, f'{xs) < 0), containing a potential barrier (an unstable 
state) of V{x) at x„ (i.e., f{xu) = 0, f'{xu) > 0). Let us compute the MFPTs T±{xo) out 
of this interval, as functions of the initial position xq- Let us admit that xa is a perfectly 
reflecting boundary 

T_{xa)=T+{xa) (98) 
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and Xb is an absorbing boundary 

T+(xb) = 0, (99) 

and, moreover, that the two alternate flows f+{x) = f{x) + Ag{x) and f-{x) = f{x) — Ag{x) 
have opposite signs throughout \x a,Xr ] (for example, /+(x) > and /_(x) < 0, Vx G 



[xa,xb])- Then one finds (see Ref. (l3Cll |): 

T+{xo) = 

, 9M r , [^(n) + f{u)/A]Ps,{u) 

.0 ' D[g{z) + f{z)/Ang{z)-f{z)/A]P,,{z)J^^ ^ g{u) 

^ DPstixA)[g\xA)-p{xA)/A'] p^^^ g{u) 



Ag{xA) D[g{u) + f{u)/Ang{u) - f (u) / A]P,,{u) ' 

(100) 



and 



T_(a;o) = T_{xb) 

dRI) - f{z)/Ang{z) + /(z)M]P,,(^) -^-^ g{u) 
DPst{xA)[g\xA)-f\xA)/A'] r- g{u 



nil 

Ag{xA) 4 D[g{u) + f{u)/Ang{u) - f{u)/A]PM ' 

(101) 

The value of T^{xb) can be obtained by taking xq = xa in equation (jlOlj) and using the 
perfectly reflecting boundary condition T_{xa) = T+{xa), together with equation pOO|) for 

Xq = Xa- 

Here Pst{x) is the stationary probability density of the dichotomous flow, 

pj^) = 9{x) r m . . 

' [g{x) + f{x)/AMx) - f{x)/A] io D[g{z) - f{z)/AMz) + f{z)/A] ' ^ ' 
and D = A^/2k. 

In the weak-noise limit D 1 { for xa < Xg < Xu and xb being the other stable point of 
the potential V{x)), using the steepest descent approximation, one obtains for the activation 
rate over the barrier at 



n = ^= exp{-A<^/D) , (103) 

1^ zvr 
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independent of xq (at order 0{D^)), and with an "Arrhenius barrier" 

/•^■" f(u) 
A$ = - / du —— ^. . . T^^T-TT . (104) 

J.s \9{u)- f{u)/A][g{u) + f{u)/A] 

One can also show that, up to order (9(D°), the activation rate TZ is equal to the Kramer's 
escape rate out of this basin of attraction. The latter one can be evaluated as the constant 
net flux of probability (or the flow of particles in an ensemble representation) through the 
borders of the domain over the integrated probability (the popu . 



ation) inside the domain 



(the so-called "flux over population" method), see also Refs. |ll9l Il4l| . Thus Kramer's rate 
can be simply obtained from the stationary master equation for the probability density of 
the process. 



It has been recently shown in Ref. |l42| . that the result written symbolically as 2251 ]: 



MFPT = (105) 

Kramer s escape rate 

holds actually for arbitrary DMN strength, and not only in the weak- noise limit. And even 
more: it is valid for an arbitrary time-homogeneous (stationary) stochastic process, and not 
only for the DMN. On the basis of this result, one can therefore express the MFPT in terms 
of the stationary probability density and avoid the complications related to the use of the 
backward equation with the cumbersome boundary conditions. 

B. Resonant activation over a fluctuating barrier 

A related problem, that is ubiquitous in natural sciences, is that of the thermally-activated 
escape over a potential barrier. In many situations of interest the noise is additive GWN 
and weak, and the escape time is governed by a simple Arrhenius factor determined by the 
height of the barrier. 

However, far from equilibrium the interplay between the noise and the global properties 
of the potential may be mu ch m ore intricate. In particular, the potential that is experienced 



by the Brownian particle 226l | cannot be always appropriately modeled as a static one, 
but it may be randomly varying on a time scale that is comparable to the escape time 
itself; this may have nontrivial resonant-like effects on the behavior of the particle. A few 
relevan t exp erimental realizations in physical, chemical, and biological systems are presented 
in Ref. |l43l | and cited references therein; they include glasses, dye lasers, biomolecular ionic 
channel kinetics, protein folding, etc. 
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As an example, let an overdamped particle which moves in a fluctuating potential V{x, t) 
with a barrier, under the influence of a heat bath at a temperature T, as described by the 
Langevin equation 

i;(t) = _V'(x,t)+eGWNW' (106) 

with (^GVK7v(ii)^GVKAr(^2)) = 2TS(ti — (provided that particle's mass, the friction co- 
efficient, and Boltzmann's constant ks were set equal to 1, and time is measured in 
terms of the friction coefficient). Consider that V{x^t) switches at random, dichotomously, 
with transition rate k, between two proflles, V±{x), with two values of the barrier height, 
y-barrier ^ -^^arrier^ p^^, very slow barrier fluctuation rates (signiflcantly slower than the 
time required to cross the highest barrier), the MFPT, as expected, approaches the average 
of the MFPTs for the alternate barrier conflgurations. Also, for barrier fluctuations that 
are fast compared to the typical crossing time, the MFPT approaches the value required to 
cross the average barrier V^ml?,^^^ = (V"_^a™6r _|_ y^arrier^^2. However, for intermediate 
fluctuation rates, a resonance-like phenomena was shown to occur, namely, it was shown that 
the MFPT over the barrier goes through a minimum when the correlation time (the inverse 
of the switching rate) of the fluctuating potential is of the order of the escape time over the 
lowest barrier Vl^&i'rier y[QYe precisely, this minimum of the MFPT (as a function of k) 
corresponds to a maximum in the probability that the barrier is in the "down" conflguration 
at the instant of crossing, as a function of the switching rate k. 

This phenomenon was called resonant activa tion. Its various aspect s and different real- 



izat i ons, were approached theoretically in Refs. 



152 



153 



141 



144, 



f 



140,11421 



154 1, iii cluding comparisons with a deterministic, periodic oscillation of the barrier 



m R ef. Il5,l[l5fi| . A simple experimental realization in an electronic circuit was studied in 
Ref. |l57j |. Comprehensive discussions of the "generic character" of the resonant activation 
(i.e., its occurence for general forms of the potential barriers, for various intensities of the 
GWN, as well as for other types of correlated fluctuations of the potential barrier - as, 
for ex amp l e, fluctua tions that are driven by an Ornstein-Uhlenbeck process) were given in 



Refs. 



Probably t he sim plest example, that admits a complete analytical treatment, can be 



found in Ref. 



144l ]. and corresponds to a symmetric piecewise potential that fluctuates. 



with a transition rate k, between V{x) and —V{x), with VG^ai^ier ^ _y'barrier ^ ^ ^ 
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see Fig. 121 



V{x) 







-V, 





FIG. 22: Piecewise linear symmetric potential that fluctuates dichotomously between the configu- 



rations V{x) and —V{x), with the barriers V_ 



barrier 



-V_ 



barrier 



> 0. 



The MFPT from to L (provided that the particle starts in x = 0, with the barrier in 
the ±y(x) configuration with equal probability 1/2, and it is absorbed aX x = L) is found 
to be: 



where 



and 



(^(0 ^ L)) T 
L2 



:i - e-°) - 



kL^a 



Vn 

ai 



Vo 

kL'^a 



Vo 
T 



Vo 



Vo 
T 



a 



{2kL''/T){aTe^'')TV^/r 



1/2 



(107) 



:io8) 



(109) 



2aVo/T{l + 2kL^T/V^){2kLyTcosha + V^/T^) ' 
A qualitative representation of the MFPT as a function of the switching rate k is given in 

Fig. |2Slfor a fixed values of Vq/T. One notices the presence of a minimum of the MFPT 

corresponding to a certain value of the barrier fiuctuation rate, that is found to be of the 
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FIG. 23: Schematic representation (continuous thick hne) of the log of the dimensionless MFPT 
(t(0 L)) as a function of the log of the dimensionless transition rate k for the piecewise linear 
symmetric potential discussed in the main text, see Fig. 1221 The dashed lines represent the two 
deterministic limits corresponding, respectively, to very slow and very high transition rates k. 

order of the inverse of the time required to "cross" the down potential configuration. For 
the hmit of slow transition rates, one finds 



(^(0 ^ ^))slow T 



L2 



2Vi 



1 - Vo/T) 



^o/T) 



(110) 



(corresponding to the mean of MFPTs over the independent deterministic "up" and "down" 
potential configurations), while in the limit of fast transition rates one finds the MFPT 
corresponding to the transition over the mean barrier (Vq) = [Vq + (— Vo)]/2 = (i.e., the 
free diffusion on a line). 



(t(0 ^ L))f^ 



'ast 



lim 



,(Vo>/T 



1 



T 



(111) 



in which the problem of 



L2 (yo>-o {V^Y ' 

We also mention the recent results of Refs. 
escape time of a particle from a metastable state with a fluctuating barrier, in the presence 
of both thermal noise and dichotomous noise, was solved in full analytical detail. The 
related problem of steady-state distributions and the exact results for the diffusion spectra 
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were addressed in Refs. 163l Il64| . Finally, general equations for computing the effective 
diffusion coefficient in randomly switching potentials are derived for arbitrary me an rate of 



the potential switching and arbitrary intensity of the Gaussian white noise, Refs. 

\m 



162, 



165 



VII. STOCHASTIC RESONANCE WITH DMN 



Generally speaking, the stochastic resonance (SR) phenomenon refers to the "enhanced 
sensitivity" of a (nonlinear) system to a s mall d eterministic periodic forcing in the presence 
of an "optimal amount" of noise - see Ref. |l67l | for a (by now incomplete) review of various 
model-systems with SR and their possible practical applications. Such a definition is very 
broad, and till now there is no agreement about the precise signature of the S R, th e necessary 
conditions of its occurrence, as well as the "right" quantifiers, see Refs. j?^ 



for further 

comments on this point. There is therefore a huge and varied literature on SR and its 



numerous rea l izati ons. In particular, for systems with DMN-driving see Refs. 



172 



173 



174, 



IZQl 



Id 



1761 for a few examples. 



A canonical model for SR is an overdamped particle in a symmetric double-well potential 
V{x) = —ax^ + bx^ (with a, b > 0), driven simultaneously by an additive GWN and an 
additive, weak periodic signal s{t), see Fig. |21] for an illustration. A "hand-waving" ar- 
gumentation for the appearance of SR would be the following. One one side, for too low 
GWN intensities, the thermally-activated jumps between the two wells are too rare and the 
particles do not take benefit of the alternate decrease of the potential barrier (on one side 
or another) due to the external signal; on the other side, for too large GWN intensities, the 
jumps between the wells are very frequent (a large number take place during one period of 
the external signal) and thus, again, the response of the system is not synchronized with 
and does not benefit of the external signal. However, for intermediate noise intensities, the 
thermally-activated transition rates are comparable with the rocking rate of the potential, 
and the particles take advantage of the alternate decrease of the potential barrier, resulting 
in an enhanced resp onse of the system to the applied external perturbation. As shown, 
for example, in Ref. |l67j |. both the spectral power amplification (SPA) (that represent the 
weight of the signal part in the output power spectrum), and the signal-to-noise ratio (SNR) 
(the SPA rescaled by the input power) represent good measures of the SR. Indeed, both of 
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FIG. 24: Schematic representation of a double-well symmetric potential that is periodically rocked 
by a weak external signal s{t). Considered are four stages of one rocking period, corresponding to 
successive maximum and minimum heights of the potential barrier. For an intermediate, optimum 
thermal noise intensity, there is a synchronization between the rocking period and the thermally- 
activated hopping between the two wells. 



them show a nonmonotonous behavior wi th a maximum as a function of the GWN intensity. 



As it was recently shown, see Refs. 



1221 

the addition of a DMN has very 



important effects on the behavior of the system: (i) DMN can synchronize the switching 
time between the two stable states of the double- well (i.e., for a certain interval of the 
GWN intensity, the mean switching rate of the system is locked to the switching rate of the 
DMN), a phenomenon corresponding, in the limit of a weak external perturbation s(t), to 
the resonant activation described in Sec. VLB; (ii) moreover, the SR is greatly enhanced by 
the DMN (i.e., the SPA and/or the SN R can reach larger maximal values as compared to 
the case when no DMN is present ) 12271 1. 

rinn 

Following Refs. |172l I173L I174| . let us illustrate these results on a simplified model. We 



shall neglect the intrawell motion, and describe only the belonging of the particle to one or 
the other wells of V{x) through the two- valued stochastic variable a{t) = ±1. The thermally- 
induced transition rate between the two- wells is given by a = exp{—AV/D), where AV is 
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the height of the potential barrier, and D is the properly-scaled GWN intensity. An additive 
DMN ^{t) = ±A of low switching rate A; ^ 1 modifies these transition rates, 

Wia,0=exp(-^^^^] , a = ±l,^ = ±A. (112) 



D 

Considering the four-state stochastic process (cr, ^) one can write down the following master 
equation: 

j^P{t; a, = -W{a, ^^(t; ^, + Wi-a, OP(t; -cr, + k[P{t; a, - P(t; a, 0] • (113) 

Therefore, the mean switching rate (MSR) of the output a{t) is found to be: 

7^ = - Ui + a2 - ^ ' ]^^, , 114 
2 V ai + 02 + 2fc/ 

with ai_2 = exp[—{AV±A)/D]. For small values of the GWN intensity D <^ 1, one recovers 
the limit of fast switching rates of the DMN, /c ^ 1, that corresponds to an effective potential 
with a lowered barrier AV — A: 

7r/2exp[-(AV- A)/D] (D < 1) . (115) 

For large noise intensities, the MSR approaches the other deterministic limit of the DMN, 
namely /c — >• 0, that corresponds to a double-well static potential with an asymmetry, 

n ^ nexp{-AV)/cosh{A/D) {D > 1) . (116) 

For intermediate values of D (and finite values of k), the MSR is locked to ^ k, and 
changes very slowly with D, a regime that corresponds to the resonant activation described 
in Sec. VLB above. 

Let us now add a small periodic perturbation to the system, s{t) = S cos{Qt + ip), with ip 
randomly uniformly distributed in [0,27r). At slow [Q < k 1) and weak [S <^ A < AV) 
forcing, the transition rates in equation ()112j) become 

W{a,0 W{a,Oexp[-Sacos{nt + ip)/D] ^ W^((t,0[1 - Sacos{nt + ip)/D] , (117) 

and the evolution of the system is described by the master equation (jllHj) with the time- 
periodic transition rates ()117|) . The autocorrelation function {a{ti)a{t2)) can be computed 
in closed analytical form in the limit of the linear-response theory with respect to the signal 
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s{t). This leads finally to the following output power spectrum (averaged over the phase (p 
of the external periodic signal s{t)): 

V{uj) = Afiuj) + S^7r7]5{uj - n) , (118) 

where 



UJ 



4(ai + 02) 
(ai + 02)^ + a;2 



1 + 



(0-2 - 0-1 



i2 



4(a2 - ai] 



{ai + a2 + 2k){Ak^ + uj^) 



;ii9) 



4A:2 + ^2 

is the power spectrum of the background (independent of the applied periodic perturbation 
s{t)). The SPA is found to be: 

4 TZ 

"^^^ (a, + a^f + ' 

and the signal-to-noise ratio is: 

'""^'-wkr ''''' 

Both the SPA rj and the SNR exhibit two maxima as a function of the GWN intensity, 
one for low noise intensities, and the other one, weaker, for large noise intensities. As seen 
above, the small-noise intensity region D <^ 1 corresponds to a potential with a lowered 
barrier, so that SR may occur for smaller noise intensity as compared to the case when no 
DMN is present: that is why SR is greatly enhanced. In the intermediate range of -D, the 
MSR is locked to the switching rate of the DMN, and thus the system is not sensitive to the 
periodic perturbation: SR does not appear. Finally, for large values of the noise intensity, 
the system behaves as an asymmetric one: SR still appears (the second peak), but during 
one-round trip switching of the DMN the system performs many transitions between the 
potential wells; thus, with further increase of the asymmetry (of the noise-intensity D) the 
SR is gradually suppressed. 

This discussion highlights the relationship between the resonant activation over a fluc- 
tuating harrier (see Sec. VLB) and the (enhanced) stochastic resonance: although both 
phenomena may appear in the same system, they are typically appearing in quite differ- 
ent regimes of the parameters of the system. This conclusion is corroborated, in a slightly 



different context, by the results of Ref. 



177|. 
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VIII. SPATIAL PATTERNS INDUCED BY DMN 



Till now, with the exception of noise-induced phase-transition situations, we considered 
only zero- dimensional systems, i.e., systems with no spatial dimensions. We will now briefly 
turn to the spatially-extended systems, for which it was shown that noise, and in particular 



178 . 
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180 



181 



182 



183 



184, 
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187 



DM N, can create spatial patterns, see Refs. 

Pattern formation in a non-fluctuating system is generically related to the onset of a 
symmetry-breaking global instability of the homogeneous state of the system. It appears 
when the control parameter (that is related to the ratio between the driving forces - that 
tend to destabilize the system - and the dissipative forces in the system - that have a stabi- 
lizing effect) exceeds a threshold value, see e.g. Ref. |l89l |. In the vicinity of the instability 
threshold, the dynamics of the system is essentially described by nonlinear amplitude equa- 
tions, that correspond to the evolution of the relevant slow modes on the central manifold 
of the critical point of the dynamics. These equations are generic, in the sense that their 
form does not depend on the details of the underlying dynamics, but only on the type of 
bifurcation that appears in the system, the symmetries of the system, the dimensionnality, 
and the eventual conservation laws. 

A well-known example of amplitude equation is the Swift-Hohenberg equation, that was 
succesfully used to describe the onset of the Rayleigh-Benard convective rolls. It corresponds 
to a system undergoing a soft pitchfork bifurcation, described by a single scalar fleld ip{f, t), 
provided that the system is invariant under spatial inversion r — r and under fleld- 
inversion ip — > —ip. Its form is: 

dtiPif, t) = -V'im t)) - {Kl + A^) V(r, t) , (122) 

where A is the Laplace operator, and V{il)) is an even function of ip (in the simpest case, 
V{il)) is just a quartic, symmetric potential), with V'{il)) = dV/dip. As long as V{il)) is 
monostable, no spatial structures appear in the system - the stable steady-state is spatially 
homogeneous. However, if under the variation of the control parameter the local potential 
V{il)) acquires two stable equilibrium points (separated by a barrier), the Swift-Hohenberg 
model leads to pattern formation with a critical wavevector K^. More precisely, one has the 
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following conditions for the marginal stability: 

V'iij) + Kl^ = , 



V'i^lj) < 



(123) 



In the case of noise-induced spatial patterns, the appearance of the pattern is strictly con- 
ditioned by the presence of the noise, i.e., no pattern appears in the noiseless, deterministic 
system. Such an example is offered by the Swift-Hohenberg equation with a time- dependent 
potential V{ip,t) that switches at random, dichotomously, between two pro files, l^jV^land 
V2{ip) (a so-called dichotomous global alternation of dynamics), see Refs. (l8lL Il82l . Il83l |. 
We consider that both potentials Vi^2('^) are monostable, i.e., neither of the two dynamics 
alone will lead to patterns (there are no patterns in the absence of the DMN). 

However, it was shown that the random alternation of the two dynamics leads to the 
appearance of stationary spatial patterns, depending on the characteristics of the potentials 
Vi^2 and on the switching rate k of the DMN. This result can be put in parallel with the 
well-known Parrondo paradox (or the fiashing ratchet mechanism), in which the (random) 
alternation between two fair games (or two unbiased diffusions) is no longer fair (is no longer 
unbiased); this means that this alter nation lea ds to a directed flow in the system - i.e., a net 

187 . 188l | for a pedagogical discussion of these points. 



gain (a directed current). See Refs. 

A simple qualitative argument can clarify the underlying mechanism. Let t = 1/k the 
average time the system is spending in each of the alternate dynamics. Of course, if the 
switching rate is very low. A; ^ 0, in-between the switches the fleld will reach, respectively, 
the stationary homogeneous states ^/^i^2 corresponding to each of the monostable potentials 

^1,2(^1,2) + ifcVi,2 = , ^"2(^^1,2) < . (124) 

Suppose now that the switching rate is very high (the sojourn time r is much smaller than 
the characteristic relaxation time in each of the alternate Vi,2 potentials). Then the evolution 
of the fleld will be driven by the deterministic effective potential Vgg(^/') = [Vi{tlj) + V2{'ip)]/2. 
If 

V^QiiP) + K^^ij = and V;:'g(^/') > , (125) 

then, according to the general considerations above, the system becomes marginally unstable 
with respect to the onset of patterns of wavevector Kc. Note that Vgg may become bistable 
only for non/mear systems (i.e., for potentials Vi,2 that are at least quadratic). Of course, by 
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continuity arguments one may expect the onset of the spatial patterns for finite switching 
rates k, too, but the marginal stability condition Eq. 



will become d ependent on k. 
When the global switching is not random, but periodic in time, see Ref. 180 . 18<\ . besides 



the stationary spatial patterns one will also obtain periodic spatio-temporal patterns. The 
case of a potential V{ip, r) that has a spat ial, quenched dichotomous disorder was also shown 



to lead to spatial patterns, see Ref. 
Moreover, as pointed out in Refs. 



184 



182l Il8q , these studies are relevant for other situations 



that lead to pattern formation, such as Turing instabilities in reaction-diffusion systems. 



IX. DISCRETE-TIME DICHOTOMOUS FLOWS 



The influence of noise on discrete-time dynamical systems (maps) is much less- 
documented than for the continuos-time ones. Aspects like the shift, broadening, or 
even suppression of bifurcations, the behavior of the invariant densities and of the 
Lyapunov exponents near the onset of chaotic behavior, and the destabilization of lo- 



cally stable states 



Refs. 
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1911 



192 



noise have been docum ented, in general, for weak GWN, see 



193 



194, 



With few exceptions, see Refs. 



19,1119611197 
;fs. I9J2QO, 



198 



201 



and references therein for examples. 



202l | , the effects of a finite correlation 



time 



201 | 



of the noise, such as a DMN, have not been addressed in general. For example, Ref. 
considers the logistic map with a dichotomously fluctuating parameter. 

Xn+l = + ^n)Xn{l - Xn) ■ (126) 

^„ is a dichotomous noise ±A with a probability a of repeating the same value in the next 
iteration (a = 1/2 corresponds to the white noise limit, while a = and a = 1 correspond 
to two deterministic limits), and fi{l + A) < 4. Such a system may derive from a continuous- 
time one which is driven by a random sequence of pulses of constant duration (this duration 
thus constitutes the time step of the map). The influence of the "correlation time" a of the 
noise on the dynamics is found to be quite dramatic: by simply varying it one can obtain 
all transitions, from chaos to regular motion. 

However, this field definitely calls for further investigations. 
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X. CONCLUSIONS AND PERSPECTIVES 



The main goal of this review was to present the DMN as a flexible and very efficient tool 
in modeling out-of-equilibrium situations, allowing to emphasize the richness and variety of 
the encountered phenomena. We hope that the reader will find in it an useful ingredient 
in his/her modeling of various experimental situations, out of which only a small part was 
reported in this paper. In this respect, we are thinking of the cutting-edge techniques that 
allow to go to the direct study and visualization of microscopic and nanoscopic systems 
(including biological, living systems): we expect coloured noise (and, in particular, DMN) 
to play an important role in modeling the interaction of such small systems with their 
surroundings. 

We also emphasize a few other opened conceptual problems. A first one would be the 
effect of inertia on dichotomous flows, and, more general, the statistical properties of sev- 
eral coupled dichotomous flows. The problem of fluctuation- like theorems for DMN-driven 
systems is to be addressed in further details. Also, as it was mentioned above, the study of 
maps driven by DMN is still an opened field. 
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[206] See, e.g., Ref. |l2l | for the discussion of the complete characterization of a stochastic process 

in terms of various associated probability distribution functions. 
[207] The justification of these conditions is rather long and delicate, and will not be given here 
(it involves the use of the stochastic Liouville equation for the phase-space density, Van 
Kampen's lemma, the Shapiro-Longinov formula of differentiation for a functional of the 
noise £,{t), etc.). See Ref. IJ] for the details of their derivation. 
[208] In the same way as the normal diffusion is obtained from the usual, simple discrete random 
walk on a lattice. 

[209] This equation is well-known in the theory of electromagnetic signal propagation in transmis- 
sion lines, and describes both the "ballistic" transmission and the damping (diffusion) of the 
signal, see the main text. A model with x-dependent transition rates k = k{x) corresponds 
to inhomogeneities in the transmission cables, see Ref. [2^ . 

[210] There are two other possible situations, but they are both trivial: (i) When one single flow 
has a stable critical point, the asymptotic distribution reduces to a (5-peak at this point, (ii) 
When none of the two flows has fixed points, the initial distribution reduces progressively to 
zero throughout the real axis - the particles escape to infinity. 

[211] In relation with the already-mentioned differences in their statistical properties, note that 
this term is different from the term corres ponding to an Ornstein-Uhlenbeck process. 



[212] Indeed, as discussed in detail in Refs. [52 



53, 



541 ]. many linear and nonlinear, deterministic 



and stochastic systems that exhibit energetic instabilities can be modeled as parametric 

oscillators which undergo the parametric resonance phenomenon. 
[213] Except for the case of the quenched disorder T — > cxo with A> 1. 
[214] Of course, the mean goes asymptotically to zero for A < \/2k + 1. 

[215] We admitted here, as a result of the law of large numbers, that {x{t)) = ''^^Xi{t)/N is a 

i 

self- averaging macroscopic intensive variable, and that its value coincides with the ensemble 

average over the realizations of S,{t). 
[216] Re-entrance (i.e., the fact that the transition appears only for certain range of parameters of 

the noise or of the deterministic part of system's dynamics) is generic in out-of-equilibrium 

phase transitions. However, it is rather rare in equilibrium situations (examples include some 

XY helimagnets and insulator-metal transitions). 
[217] An exception is discussed in Ref. js^ . 
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[218] Just like in a mean-field like description of equilibrium situations. 

[219] Although completely academic, this model was first introduced because of its simplicity: no 
simpler forms for f{x) and g{x) were found to lead to phase transitions. 

[220] Where the phase diagram was obtained analytically up to a point, and afterwards by symbolic 
calculations. 

[221] Actually, the only "stringent" condition is that f±{x) are continuous over the spatial period. 

Under special circumstances, even this condition can be relaxed, as it will becom clear from 

the examples we shall be considering in the next subsections. 
[222] Although very simple and seemingly robust, this particular system has not been realized 

experimentally yet. We are currently investigating the possibility of its realization using a 

SQUID. 

[223] A classical illustration is given by the Smoluchowski-Feynman ratchet-and-pawl device in 

contact with a single thermostat, see Ref. 8^ . 
[224] Such that directed current is not ruled out by Curie's symmetry principle, "If a certain 

phenomenon is not ruled-out by symmetries, then it may /will appear". 



[225] See Ref. 



1421 ] for the right interpretation of Eq. ()1U5() 



[226] Recall that the term "Brownian particle" may refer to a true particle, but it may also 
represent some other state variable or collective coordinate of the current system under 
study. 

[227] Note that the DMN is weak and cannot, by itself, induce transitions between the stable states 
of the double-well potential: the jumps are still induced by the GWN. 
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